-- Logs begin at Mon 2022-02-21 00:42:36 UTC, end at Mon 2022-02-21 01:56:13 UTC. -- Feb 21 01:23:08.996805 dv-cinder-813228-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 21 01:23:09.004336 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 21 01:23:09.006340 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 21 01:23:09 2022] *** Feb 21 01:23:09.006340 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 21 01:23:09.006340 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 21 01:23:09.006340 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: nodename: dv-cinder-813228-6-iscsi Feb 21 01:23:09.006340 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: machine: x86_64 Feb 21 01:23:09.006340 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: clock source: unix Feb 21 01:23:09.006340 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: pcre jit disabled Feb 21 01:23:09.006875 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: detected number of CPU cores: 4 Feb 21 01:23:09.006875 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: current working directory: / Feb 21 01:23:09.006875 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: detected binary path: /usr/bin/uwsgi-core Feb 21 01:23:09.006875 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: your processes number limit is 47680 Feb 21 01:23:09.006875 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: your memory page size is 4096 bytes Feb 21 01:23:09.006875 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: detected max file descriptor number: 2048 Feb 21 01:23:09.006875 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: lock engine: pthread robust mutexes Feb 21 01:23:09.006875 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: thunder lock: enabled Feb 21 01:23:09.006875 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 21 01:23:09.006875 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 21 01:23:09.052970 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: Python main interpreter initialized at 0x55824ed699c0 Feb 21 01:23:09.052970 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: python threads support enabled Feb 21 01:23:09.052970 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: your server socket listen backlog is limited to 100 connections Feb 21 01:23:09.052970 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: your mercy for graceful operations on workers is 90 seconds Feb 21 01:23:09.053318 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: mapped 403077 bytes (393 KB) for 2 cores Feb 21 01:23:09.053425 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: *** Operational MODE: preforking *** Feb 21 01:23:09.053685 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: *** uWSGI is running in multiple interpreter mode *** Feb 21 01:23:09.053685 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: spawned uWSGI master process (pid: 102414) Feb 21 01:23:09.053876 dv-cinder-813228-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 21 01:23:09.054539 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: spawned uWSGI worker 1 (pid: 102415, cores: 1) Feb 21 01:23:09.054749 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: spawned uWSGI worker 2 (pid: 102416, cores: 1) Feb 21 01:23:09.054909 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 21 01:23:10.877025 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 01:23:10.877025 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: from cryptography.utils import int_from_bytes Feb 21 01:23:10.915843 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 01:23:10.915843 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: from cryptography.utils import int_from_bytes Feb 21 01:23:10.916012 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 01:23:10.916012 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: from cryptography.utils import int_from_bytes Feb 21 01:23:10.916012 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 01:23:10.916012 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: from cryptography.utils import int_from_bytes Feb 21 01:23:13.440065 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 01:23:13.440678 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 01:23:13.440827 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 01:23:13.441185 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 01:23:13.441446 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 01:23:13.441828 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.442151 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.442469 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.442784 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.442878 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 01:23:13.443255 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 01:23:13.443349 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.443444 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.443531 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 01:23:13.443710 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.443900 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 01:23:13.444024 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.444160 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 01:23:13.444349 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.444579 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.444676 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.444911 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.445012 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.445238 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813228-6-iscsi {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.445337 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.445559 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.445653 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.445862 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.445958 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.446169 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.446262 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.446486 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.446593 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.446788 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.446891 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.447106 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.447201 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.447411 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.447508 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.447732 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.447920 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.448063 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813228-6-iscsi {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.448363 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.448512 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.448696 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.448825 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.449008 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.449133 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.449330 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.449426 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.449639 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.449737 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.449950 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.450048 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.450268 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.450382 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.450570 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.450777 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.450885 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.451094 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.451189 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.451404 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.451577 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813228-6-iscsi {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.451720 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.451874 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.452061 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.452235 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.452381 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.452545 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.452724 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.452899 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.453051 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.453208 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.453365 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.453515 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.453694 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.453833 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.454008 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.454151 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.454407 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813228-6-iscsi {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.454500 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.454725 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.454868 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.455041 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.455140 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.455357 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.455452 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.455680 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.455767 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.455981 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.456075 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.456288 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.456382 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.456622 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.456728 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.456937 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.457026 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.457241 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.457340 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.457545 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.457639 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.457794 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.457963 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.458097 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.458289 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.458416 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.458614 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.458737 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.458923 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.459058 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.459237 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.459325 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.459545 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.459641 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.459861 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.459957 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.460173 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.460286 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.460499 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.460610 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.460756 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.460852 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.461068 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.461157 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.461395 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.461493 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.461697 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.461788 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.462001 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.462099 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.462273 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.462373 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.462528 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.462624 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.462850 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.463430 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.463690 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.463780 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.464006 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.464101 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.464312 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.464405 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.464648 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.464738 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.464961 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.465050 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.465273 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.465361 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.465578 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.465666 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.465888 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.465985 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.466198 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.466299 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.466513 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.466623 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.466828 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.466917 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.467143 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.467243 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.467447 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.467535 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.467754 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.467841 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.468057 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.468153 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.468375 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.468494 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.468724 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.468822 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.469027 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.469125 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.469277 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.469364 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.469575 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.469661 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.469879 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.469968 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.470197 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.470292 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.470500 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.470587 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.470804 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.470900 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.471106 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.471200 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.471405 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.471499 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.471708 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.471829 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.472021 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.472123 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.472326 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.472420 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.472655 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.472745 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.472961 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.473052 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.473262 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.473350 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.473566 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.473662 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.473869 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.473963 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.474173 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.474274 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.474492 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.474578 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.474807 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.474903 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.475110 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.475206 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.475414 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.475501 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.475716 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.475804 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.476020 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.476117 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.476325 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.476419 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.476669 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.476755 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.476973 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.477073 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.477282 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.477376 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.477583 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.477669 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.477886 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.478051 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.478201 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.478302 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.478526 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.479125 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.479358 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.479459 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.479671 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.479765 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.479971 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.480065 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.480277 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.480377 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.480616 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.480705 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.480924 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.481020 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.481227 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.481323 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.481527 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.481623 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.481833 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.481921 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.482133 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.482228 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.482436 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.482532 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.482736 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.482831 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.483037 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.483125 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.483336 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.483436 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.483649 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.483737 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.483959 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.484057 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.484262 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.484349 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.484590 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.484692 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.484892 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.484991 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.485199 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.485293 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.485512 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.485610 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.485821 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.485909 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.486131 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.486224 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.486436 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.486541 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.486761 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.486849 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.487085 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.487185 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.487396 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.487491 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.487705 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.487794 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.488013 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.488101 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.488334 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:23:13.488456 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.488666 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.488753 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.488973 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.489060 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.489280 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.489369 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.489593 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.489687 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.489906 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.490001 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.490231 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.490320 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.490543 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.490667 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.490853 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.490941 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.491166 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.491261 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.491473 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.491560 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.491788 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.491899 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.492112 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.492201 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.492465 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.492569 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.492764 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.492860 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.493098 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.493193 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.493433 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.493521 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.493738 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.493825 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.494058 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.494154 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.494402 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.494490 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.494713 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.494810 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.495022 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.495113 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.495332 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.495421 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.495655 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.495752 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.495971 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.496065 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.496282 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.496377 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.496622 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.496724 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.496933 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.497064 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.497241 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.497331 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.497550 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.497651 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.497859 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.497991 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.498167 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.498256 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.498499 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.498588 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.498813 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.498901 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.499126 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.499214 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.499437 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.499533 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.499750 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.499844 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.500059 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.500146 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.500368 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.500512 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.500704 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.500800 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.501008 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.501103 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.501313 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.501402 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.501617 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.501732 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.501935 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.502037 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.502238 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.502327 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.502803 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.502898 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.503131 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.503227 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.503438 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.503526 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.503752 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.503840 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.504064 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.504163 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.504374 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.504479 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.504709 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.504806 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.505020 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.505183 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.505325 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.505419 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.505632 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.505719 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.505939 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.506027 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.506243 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.506331 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.506564 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.506653 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.506872 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.506968 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.507176 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.507272 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.507496 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.507585 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.507799 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.507888 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.508102 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.508189 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.508410 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.508539 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.508739 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.508827 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.509046 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.509156 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.509354 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.509451 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.509661 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.509859 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.510012 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.510112 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.510325 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.510424 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.510661 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.510809 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.510973 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.511075 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.511285 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.511385 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.511605 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.511694 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.511922 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.512019 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.512238 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.512338 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.512575 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.512664 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.512884 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.512972 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.513192 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.513304 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.513497 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.513586 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.513800 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.513896 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.514102 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.514190 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.514409 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.514497 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.514711 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.514809 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.515012 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.515149 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.515312 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.515409 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.515613 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.515701 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.515913 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.516002 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.516235 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.516323 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.516568 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.516671 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.516874 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.516970 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.517175 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.517318 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.517477 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.517574 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.517802 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.517914 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.518105 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.518200 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.518411 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.518511 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.518721 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.518809 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.519030 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.519118 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.519358 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.519460 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.519670 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.519765 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.519976 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.520063 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.520282 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.520376 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.520617 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.520705 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.520927 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.521014 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.521235 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.521334 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.521553 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.521641 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.521866 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.521961 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.522181 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.522270 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.522488 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.522576 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.522810 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.522904 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.523118 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.523206 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.523433 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.523528 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.523736 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.523824 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.524051 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.524146 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.524370 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.524488 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.524727 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.524823 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.525044 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.525131 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.525881 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.525981 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.526233 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.526330 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.526568 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.526656 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.526884 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.526972 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.527212 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.527309 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.527520 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.527608 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.527832 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.527919 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.528150 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.528253 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.528480 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.528572 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.528800 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.528889 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.529108 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.529196 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.529431 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.529519 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.529740 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.529835 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.530057 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.530151 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.530359 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.530447 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.530672 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.530767 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.530986 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.531082 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.531315 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.531403 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.531620 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.531709 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.531937 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.532026 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.532251 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.532339 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.532578 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.532669 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.532888 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.532978 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.533196 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.533284 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.533500 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.533596 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.533805 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.533893 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.534112 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.534200 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.534425 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.534521 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.534732 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.534828 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.535042 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.535138 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.535343 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.535492 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.535654 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.535742 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.535962 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.536051 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.536264 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.536363 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.536588 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.536691 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.536898 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.536986 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.537215 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.537311 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.537520 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.537607 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.537833 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.537920 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.538149 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.538236 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.538450 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.538537 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.538751 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.538838 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.539069 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.539163 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.539372 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.539459 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.539674 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.539762 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.539975 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.540063 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.540275 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.540370 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.540634 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.540734 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.540939 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.541139 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.541295 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.541393 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.541611 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.541709 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.541927 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.542015 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.542233 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.542327 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.542542 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.542640 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.542850 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.542945 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.543155 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.543244 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.543461 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.543557 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.543771 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.543864 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.544077 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.544171 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.544384 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.544508 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.544716 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.544805 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.545024 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.545112 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.545331 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.545422 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.545650 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.545739 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.545954 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.546050 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.546259 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.546349 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.546565 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.546653 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.546865 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.546953 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.547172 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.547261 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.547486 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.547613 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.547800 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.548045 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.548134 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.548373 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.548490 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.548710 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.548798 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.549025 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.549114 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.549341 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.549436 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.549655 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.549742 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.549961 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.550049 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.550278 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.550367 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.550610 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.550698 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.550908 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.551176 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.551274 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.551503 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.551591 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.551810 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.551898 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.552117 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.552207 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.552418 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.552537 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.552739 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.552828 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.553038 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.553127 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.553345 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.553433 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.553648 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.553745 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.553949 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.554045 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.554249 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.554401 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.554550 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.554638 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.554857 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.554952 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.555158 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.555246 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.555467 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.555555 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.555771 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.555860 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.556090 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.556178 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.556396 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.556555 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.557235 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.557327 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.557537 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.557632 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.557839 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.557928 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.558150 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.558239 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.558467 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.558555 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.558777 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.558873 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.559097 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.559185 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.559409 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.559498 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.559727 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.559827 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.560030 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.560157 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.560339 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.560454 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.560666 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.560766 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.560970 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.561059 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.561273 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.561360 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.561579 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.561675 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.561884 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.561971 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.562183 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.562271 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.562497 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.562586 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.562802 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.562898 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.563108 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.563205 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.563413 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.563502 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.563711 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.563799 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.564015 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.564103 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.564315 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.564404 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.564650 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.564747 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.564955 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.565052 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.565255 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.565351 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.565555 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.565643 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.565860 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.565960 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.566164 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.566252 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.566464 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.566552 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.566771 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.566866 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.567070 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.567157 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.567382 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.567477 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.567683 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.567818 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.567982 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.568079 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.568281 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.568368 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.568610 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.568708 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.568916 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.569011 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.569215 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.569303 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.569520 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.569608 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.569826 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.569950 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.570126 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.570252 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.570426 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.570522 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.570730 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.570818 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.571030 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.571117 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.571328 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.571417 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.571633 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.571722 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.571945 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.572033 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.572290 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.572889 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.573111 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.573200 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.573418 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.573523 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.573721 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.573809 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.574021 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.574108 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.574322 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.574418 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.574629 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.574724 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.574926 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.575014 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.575226 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.575326 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.575524 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.575613 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.575824 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.575911 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.576123 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.576219 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.576460 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.576550 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.576771 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.576859 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.577073 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.577162 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.577372 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.577468 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.577672 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.577761 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.577977 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.578072 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.578285 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.578381 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.578592 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.578746 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.578900 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.578990 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.579207 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.579296 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.579521 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.579607 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.579828 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.579917 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.580134 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.580221 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.580455 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.580560 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.580762 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.580849 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.581073 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.581169 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.581381 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.581476 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.581689 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.581821 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.581991 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.582080 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.582296 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.582393 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.582614 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.582702 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.582922 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.583010 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.583229 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.583327 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.583545 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.583634 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.583854 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.583941 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.584171 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.584268 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.584508 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.584598 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.584819 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.584915 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.585126 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.585215 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.585429 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.585515 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.585736 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.585830 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.586041 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.586138 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.586349 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.586451 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.586659 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.586748 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.586967 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.587063 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.587276 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.587372 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.587587 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.587675 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.587911 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.588040 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.588223 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.588320 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.588560 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.588666 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.588866 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.588954 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.589180 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.589276 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.589487 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.589582 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.589791 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.589881 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.590101 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.590197 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.590406 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.590508 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.590717 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.590806 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.591023 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.591110 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.591336 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.591437 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.591650 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.591747 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.591962 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.592053 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.592293 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.592390 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.592635 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.592734 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.592945 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.593044 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.593257 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.593345 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.593564 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.593659 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.593865 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.593959 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.594176 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.594264 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.594571 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.594667 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.594880 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.594968 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.595190 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.595286 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.595493 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.595581 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.595793 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.595890 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.596103 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.596194 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.596420 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.596539 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.596746 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.596844 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.597048 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.597137 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.597352 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.597466 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.597674 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.597771 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.597977 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.598088 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.598297 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.598393 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.598702 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.598802 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.599009 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.599096 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.599313 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.599401 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.599640 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.599728 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.599953 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.600042 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.600265 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.600352 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.600600 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.600691 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.600929 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.601018 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.601243 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.601331 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.601553 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.601642 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.601870 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.601986 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.602178 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.602288 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.602507 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.602605 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.602829 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.602984 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.603139 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.603301 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.603452 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.603787 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.603919 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.604010 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.604093 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.604276 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.604407 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.604631 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.604725 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.604943 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.605040 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.605263 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.605447 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.605580 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.605770 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.605910 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.606083 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.606243 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.606403 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.606621 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.606715 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.606869 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.607018 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.607180 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.607323 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.607511 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.607631 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.607841 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.607931 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.608160 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.608305 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.608513 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.608606 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.608865 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.608955 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.609173 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.609271 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.609481 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.609570 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.609787 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.609876 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.610090 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.610187 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.610395 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.610485 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.610715 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.610803 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.611015 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.611113 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.611336 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.611438 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.611652 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.611769 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.611970 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.612092 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.614774 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.614942 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.615071 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.615184 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.615304 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.615422 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.615530 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.615639 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.615759 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.615886 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.616138 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.616263 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.616383 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.616521 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.616632 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.616740 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.617396 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.617487 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.617569 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.617650 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.617739 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.617823 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.617904 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.617982 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.618074 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.618157 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.618247 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.618386 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.618478 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.618569 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.618651 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.618733 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.618823 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.618918 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.619000 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.619082 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.619684 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.619772 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.619868 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.619952 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.620033 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.620125 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.620207 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.620297 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.620385 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.620491 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.620574 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.620655 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.620731 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.620814 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.620892 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.620982 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.620982 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.621141 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.621222 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.621315 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.621520 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.621610 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.621824 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.621915 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.622148 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.622255 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.622456 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.622546 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.622766 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.622855 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.623069 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.623158 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.623372 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.623462 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.623685 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.623775 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.623996 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.624088 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.624307 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.624396 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.624644 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.624744 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.624963 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.625054 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.625273 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.625362 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.625584 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.625672 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.625906 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.625996 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.626219 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.626321 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.626529 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.626627 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.626839 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.626928 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.627150 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.627247 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.627464 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.627931 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.628029 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.628121 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.628336 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.628505 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.628670 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.628782 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.628985 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.629075 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.629298 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.629395 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.629612 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.629710 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.629957 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.630138 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.630282 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.630467 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.630606 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.630781 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.630931 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.631094 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.631257 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.631405 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.631579 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.631718 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.631899 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.632029 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.632214 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.632341 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.632560 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.632665 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.632882 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.632973 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.633205 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.633296 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.633588 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.633736 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.633906 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.634071 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.634230 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.634394 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.634562 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.634712 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.635413 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.635572 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.635728 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.635896 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.636042 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.636225 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.636363 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.636573 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.636720 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.636896 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.637030 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.637201 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.637332 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.637519 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.637646 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.637851 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.637961 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.638182 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.638272 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.638517 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.638620 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.638857 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.638952 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.639166 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.639254 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.639478 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.639568 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.639787 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.639876 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.640095 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.640183 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.640405 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.640555 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.640738 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.640828 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.641060 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.641160 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.641394 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.641486 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.641712 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.641802 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.642023 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.642121 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.642334 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.642423 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.642645 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.642735 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.642963 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.643168 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.643272 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.643480 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.643569 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.643812 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.643910 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.644135 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.644224 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.644479 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.644572 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.644798 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.644897 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.645113 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.645202 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.645436 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.645549 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.645740 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.645847 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.646042 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.646132 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.646350 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.646484 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.646655 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.646906 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.646998 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.647231 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.647320 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.647560 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.647673 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.647863 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.647953 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.648179 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.648267 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.648512 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.648616 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.648861 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.649044 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.649195 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.649389 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.649511 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.649704 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.649826 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.650029 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.650145 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.650355 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.650477 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.650706 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.650805 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.651013 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.651157 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.651338 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.651445 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.651644 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.651734 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.651949 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.652039 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.652263 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.652369 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.652597 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.652880 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.652971 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.653199 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.653287 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.653509 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.653611 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.653815 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.653918 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.654118 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.654207 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.654427 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.654518 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.654731 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.654816 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.655054 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.655141 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.655359 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.655438 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.655662 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.655741 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.655966 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.656053 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.656275 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.656354 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.656602 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.656684 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.656908 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.657000 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.657212 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.657290 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.657515 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.657593 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.657824 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.657910 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.658125 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.658202 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.658432 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.658511 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.658735 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.658814 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.659044 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.659122 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.659347 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.659438 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.659657 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.659742 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.659977 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.660064 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.660288 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.660375 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.660627 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.660709 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.660928 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.661019 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.661242 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.661321 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.661550 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.661640 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.661856 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.661942 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.662165 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.662251 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.662474 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.662552 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.662791 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.662869 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.663102 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.663188 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.663417 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.663637 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.663783 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.663974 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.664114 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.664294 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.664473 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.664653 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.664743 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.664984 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.665077 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.665291 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.665383 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.665597 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.665686 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.665902 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.666589 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.666746 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.666836 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.667057 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.667147 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.667367 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.667465 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.667678 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.667979 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.668069 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.668286 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.668375 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.668626 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.668740 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.671031 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.671134 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.671207 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.671287 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.671358 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.671432 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.671510 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.671581 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.671649 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.671729 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.671799 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.671867 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.671935 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.672029 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.672106 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.672204 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.672281 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.672350 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.672418 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.672535 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.672608 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.672749 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.672832 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.673172 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.673260 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.673330 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.673409 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.673480 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.673549 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.673617 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.673692 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.673761 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.673847 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.673918 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.674078 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.674193 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.674382 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.674521 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.674800 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.674882 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.675113 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.675191 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.675432 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.675525 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.675753 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.675858 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.676063 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.676153 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.676384 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.676511 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.676730 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.676832 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.677042 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.677130 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.677361 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.677460 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.677671 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.677761 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.677998 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.678089 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.678312 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.678410 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.678649 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.678737 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.678976 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.679065 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.679283 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.679373 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.679587 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.679684 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.679943 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.680041 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.680292 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.680412 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.680662 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.680756 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.680986 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.681085 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.681318 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.681408 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.681700 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.682311 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.682568 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.682857 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.682958 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.683284 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.683396 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.683578 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.683794 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.683896 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.684130 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.684221 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.684483 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.684578 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.684813 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.684914 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.685130 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.685221 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.685473 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.685564 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.685793 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.685884 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.686109 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.686199 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.686425 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.686515 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.686738 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.686829 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.687050 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.687152 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.687362 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.687452 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.687693 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.687783 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.688015 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.688105 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.688320 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.688417 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.688689 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.688898 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.689011 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.689219 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.689332 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.689541 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.689633 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.689860 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.689949 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.690303 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.690408 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.690573 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.690889 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.690979 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.691219 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.691309 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.691538 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.691629 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.691856 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.691945 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.692173 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.692264 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.692512 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.692618 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.692833 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.692924 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.693150 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.693263 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.693514 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.693605 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.693790 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.693880 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.694107 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.694206 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.694429 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.694529 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.694746 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.694836 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.695063 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.695162 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.695386 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.695477 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.695707 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.695796 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.696021 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.696120 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.696338 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.696451 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.696671 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.696761 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.696919 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 01:23:13.697091 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.697418 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.697742 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.698096 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.698434 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.698758 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.699078 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.699391 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:23:13.699641 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 01:23:13.719817 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG oslo_db.sqlalchemy.engines [None req-39d5ae50-34c5-4cdd-9de7-2dd4e5370ed3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:23:13.721862 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG oslo_db.sqlalchemy.engines [None req-6e14d1f2-3d53-4465-8f73-cd452760e6cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102416) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:23:13.781680 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.context [None req-39d5ae50-34c5-4cdd-9de7-2dd4e5370ed3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cee51e8e-7ef6-449d-9af5-b8ee4b8e6645(cell1) {{(pid=102415) load_cells /opt/stack/nova/nova/context.py:464}} Feb 21 01:23:13.784397 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.context [None req-6e14d1f2-3d53-4465-8f73-cd452760e6cd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cee51e8e-7ef6-449d-9af5-b8ee4b8e6645(cell1) {{(pid=102416) load_cells /opt/stack/nova/nova/context.py:464}} Feb 21 01:23:13.785957 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG oslo_concurrency.lockutils [None req-39d5ae50-34c5-4cdd-9de7-2dd4e5370ed3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:23:13.787522 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG oslo_concurrency.lockutils [None req-39d5ae50-34c5-4cdd-9de7-2dd4e5370ed3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:23:13.788328 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG oslo_concurrency.lockutils [None req-39d5ae50-34c5-4cdd-9de7-2dd4e5370ed3 None None] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:23:13.788622 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG oslo_concurrency.lockutils [None req-6e14d1f2-3d53-4465-8f73-cd452760e6cd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:23:13.790191 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG oslo_concurrency.lockutils [None req-6e14d1f2-3d53-4465-8f73-cd452760e6cd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:23:13.790283 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG oslo_concurrency.lockutils [None req-39d5ae50-34c5-4cdd-9de7-2dd4e5370ed3 None None] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:23:13.791533 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG oslo_concurrency.lockutils [None req-6e14d1f2-3d53-4465-8f73-cd452760e6cd None None] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:23:13.793500 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG oslo_concurrency.lockutils [None req-6e14d1f2-3d53-4465-8f73-cd452760e6cd None None] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:23:13.800860 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG oslo_db.sqlalchemy.engines [None req-39d5ae50-34c5-4cdd-9de7-2dd4e5370ed3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:23:13.804137 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG oslo_db.sqlalchemy.engines [None req-39d5ae50-34c5-4cdd-9de7-2dd4e5370ed3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:23:13.807706 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG oslo_db.sqlalchemy.engines [None req-6e14d1f2-3d53-4465-8f73-cd452760e6cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102416) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:23:13.810868 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG oslo_db.sqlalchemy.engines [None req-6e14d1f2-3d53-4465-8f73-cd452760e6cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102416) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:23:13.960904 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG oslo_db.sqlalchemy.engines [None req-39d5ae50-34c5-4cdd-9de7-2dd4e5370ed3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:23:13.968205 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG oslo_db.sqlalchemy.engines [None req-6e14d1f2-3d53-4465-8f73-cd452760e6cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102416) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:23:14.359158 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: WARNING keystonemiddleware.auth_token [None req-39d5ae50-34c5-4cdd-9de7-2dd4e5370ed3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 01:23:14.365695 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: WARNING keystonemiddleware.auth_token [None req-39d5ae50-34c5-4cdd-9de7-2dd4e5370ed3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 01:23:14.376591 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: WARNING keystonemiddleware.auth_token [None req-6e14d1f2-3d53-4465-8f73-cd452760e6cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 01:23:14.383443 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: WARNING keystonemiddleware.auth_token [None req-6e14d1f2-3d53-4465-8f73-cd452760e6cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 01:23:14.702670 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: WARNING keystonemiddleware.auth_token [None req-39d5ae50-34c5-4cdd-9de7-2dd4e5370ed3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 01:23:14.707895 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: WARNING keystonemiddleware.auth_token [None req-39d5ae50-34c5-4cdd-9de7-2dd4e5370ed3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 01:23:14.713054 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55824ed699c0 pid: 102415 (default app) Feb 21 01:23:14.715153 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-39d5ae50-34c5-4cdd-9de7-2dd4e5370ed3 None None] Calling method '>' {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:23:14.716540 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-39d5ae50-34c5-4cdd-9de7-2dd4e5370ed3 None None] 10.222.0.90 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001935 Feb 21 01:23:14.716954 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 1/1] 10.222.0.90 () {50 vars in 788 bytes} [Mon Feb 21 01:23:14 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:23:14.725073 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: WARNING keystonemiddleware.auth_token [None req-6e14d1f2-3d53-4465-8f73-cd452760e6cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 01:23:14.731040 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: WARNING keystonemiddleware.auth_token [None req-6e14d1f2-3d53-4465-8f73-cd452760e6cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 01:23:14.736163 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55824ed699c0 pid: 102416 (default app) Feb 21 01:24:38.958230 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-39d5ae50-34c5-4cdd-9de7-2dd4e5370ed3 None None] Calling method '>' {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:38.959807 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-39d5ae50-34c5-4cdd-9de7-2dd4e5370ed3 None None] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001989 Feb 21 01:24:38.961031 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 2/2] 10.222.0.90 () {54 vars in 930 bytes} [Mon Feb 21 01:24:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:24:39.417016 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-3f5ac799-3006-422e-9ec2-3bd26eaf8789 admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:39.446677 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-3f5ac799-3006-422e-9ec2-3bd26eaf8789 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.478996 Feb 21 01:24:39.447389 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 1/3] 10.222.0.90 () {60 vars in 1291 bytes} [Mon Feb 21 01:24:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:24:41.828697 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-39d5ae50-34c5-4cdd-9de7-2dd4e5370ed3 None None] Calling method '>' {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:41.829700 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-39d5ae50-34c5-4cdd-9de7-2dd4e5370ed3 None None] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Feb 21 01:24:41.830108 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 3/4] 10.222.0.90 () {54 vars in 930 bytes} [Mon Feb 21 01:24:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:24:41.890965 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-32c2754f-0bed-4dc0-899d-68a34d4c2a99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 256, "vcpus": 1, "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true, "id": "c1", "disk": 1}} {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:24:41.908922 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:24:41.908922 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: warnings.warn(msg) Feb 21 01:24:42.001551 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-32c2754f-0bed-4dc0-899d-68a34d4c2a99 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.164920 Feb 21 01:24:42.002374 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 2/5] 10.222.0.90 () {64 vars in 1282 bytes} [Mon Feb 21 01:24:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 01:24:42.223901 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-408ed137-e1ad-41d3-a16b-058e21423262 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:24:42.226862 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:24:42.226862 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: warnings.warn(msg) Feb 21 01:24:42.342307 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-408ed137-e1ad-41d3-a16b-058e21423262 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.331369 Feb 21 01:24:42.342892 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 4/6] 10.222.0.90 () {64 vars in 1335 bytes} [Mon Feb 21 01:24:42 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:24:44.789412 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-32c2754f-0bed-4dc0-899d-68a34d4c2a99 admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:44.790426 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-32c2754f-0bed-4dc0-899d-68a34d4c2a99 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Feb 21 01:24:44.791135 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 3/7] 10.222.0.90 () {54 vars in 930 bytes} [Mon Feb 21 01:24:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:24:44.906575 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-fb4e8e53-d513-4382-86aa-2150a94f4c45 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "swap": 0, "name": "ds512M", "id": "d1", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:24:44.924403 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:24:44.924403 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: warnings.warn(msg) Feb 21 01:24:45.029787 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-fb4e8e53-d513-4382-86aa-2150a94f4c45 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.232706 Feb 21 01:24:45.030505 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 5/8] 10.222.0.90 () {64 vars in 1282 bytes} [Mon Feb 21 01:24:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:45.043301 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-3641de9f-5528-4933-9b67-df675a0cbfae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:24:45.044813 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:24:45.044813 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: warnings.warn(msg) Feb 21 01:24:45.150937 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-3641de9f-5528-4933-9b67-df675a0cbfae admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111224 Feb 21 01:24:45.151748 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 4/9] 10.222.0.90 () {64 vars in 1335 bytes} [Mon Feb 21 01:24:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:24:47.523325 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-fb4e8e53-d513-4382-86aa-2150a94f4c45 admin admin] Calling method '>' {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:47.524958 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-fb4e8e53-d513-4382-86aa-2150a94f4c45 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002052 Feb 21 01:24:47.525546 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 6/10] 10.222.0.90 () {54 vars in 930 bytes} [Mon Feb 21 01:24:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:24:47.584903 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-6ba2235a-811e-44bf-a5d2-48f2c4239aff admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "disk": 10, "os-flavor-access:is_public": true, "id": "d2", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:24:47.701835 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-6ba2235a-811e-44bf-a5d2-48f2c4239aff admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.170373 Feb 21 01:24:47.702462 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 5/11] 10.222.0.90 () {64 vars in 1282 bytes} [Mon Feb 21 01:24:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 01:24:47.714741 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-927e57a4-2cb2-4a8d-b9e4-4a279937df2a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:24:47.847510 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-927e57a4-2cb2-4a8d-b9e4-4a279937df2a admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.136542 Feb 21 01:24:47.848210 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 7/12] 10.222.0.90 () {64 vars in 1335 bytes} [Mon Feb 21 01:24:47 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:24:50.219712 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-6ba2235a-811e-44bf-a5d2-48f2c4239aff admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:50.220782 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-6ba2235a-811e-44bf-a5d2-48f2c4239aff admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Feb 21 01:24:50.221188 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 6/13] 10.222.0.90 () {54 vars in 930 bytes} [Mon Feb 21 01:24:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:24:50.289053 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-a475e20d-8597-45a6-819f-9e700663d595 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 2048, "name": "ds2G", "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "id": "d3"}} {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:24:50.415595 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-a475e20d-8597-45a6-819f-9e700663d595 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.188035 Feb 21 01:24:50.416060 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 8/14] 10.222.0.90 () {64 vars in 1282 bytes} [Mon Feb 21 01:24:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 01:24:50.427852 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-c7347716-bd3e-40e5-a9da-c88f78269959 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:24:50.536295 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-c7347716-bd3e-40e5-a9da-c88f78269959 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112191 Feb 21 01:24:50.537039 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 7/15] 10.222.0.90 () {64 vars in 1335 bytes} [Mon Feb 21 01:24:50 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:24:52.888925 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-a475e20d-8597-45a6-819f-9e700663d595 admin admin] Calling method '>' {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:52.889844 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-a475e20d-8597-45a6-819f-9e700663d595 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Feb 21 01:24:52.890241 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 9/16] 10.222.0.90 () {54 vars in 930 bytes} [Mon Feb 21 01:24:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:24:52.953688 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-ca4c2e6f-7689-4b50-aba7-a716d5275204 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "name": "ds4G", "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "vcpus": 4}} {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:24:53.032556 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-ca4c2e6f-7689-4b50-aba7-a716d5275204 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.136331 Feb 21 01:24:53.035517 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 8/17] 10.222.0.90 () {64 vars in 1282 bytes} [Mon Feb 21 01:24:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 01:24:53.045180 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-97b88971-500c-4eb7-8cf8-58953f48d15e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:24:53.139158 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-97b88971-500c-4eb7-8cf8-58953f48d15e admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097481 Feb 21 01:24:53.140008 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 10/18] 10.222.0.90 () {64 vars in 1335 bytes} [Mon Feb 21 01:24:53 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:24:55.535476 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-ca4c2e6f-7689-4b50-aba7-a716d5275204 admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:55.536888 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-ca4c2e6f-7689-4b50-aba7-a716d5275204 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001845 Feb 21 01:24:55.537433 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 9/19] 10.222.0.90 () {54 vars in 930 bytes} [Mon Feb 21 01:24:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:24:55.627113 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-24c38b08-500c-4e81-98d5-82470008a415 admin admin] Calling method '>' {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:55.655657 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-24c38b08-500c-4e81-98d5-82470008a415 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.111436 Feb 21 01:24:55.656208 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 11/20] 10.222.0.90 () {60 vars in 1291 bytes} [Mon Feb 21 01:24:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:24:57.997710 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-ca4c2e6f-7689-4b50-aba7-a716d5275204 admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:24:57.998756 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-ca4c2e6f-7689-4b50-aba7-a716d5275204 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Feb 21 01:24:57.999192 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 10/21] 10.222.0.90 () {54 vars in 930 bytes} [Mon Feb 21 01:24:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:24:58.064836 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-b3d798c4-6316-4cb1-8e49-bf42129c9a0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "id": "1", "swap": 0, "ram": 512}} {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:24:58.152954 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-b3d798c4-6316-4cb1-8e49-bf42129c9a0a admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.147448 Feb 21 01:24:58.153511 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 12/22] 10.222.0.90 () {64 vars in 1282 bytes} [Mon Feb 21 01:24:58 2022] POST /compute/v2.1/flavors => generated 402 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:24:58.169021 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-e49490db-5e95-40db-a483-fdafb419552f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:24:58.260889 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-e49490db-5e95-40db-a483-fdafb419552f admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096474 Feb 21 01:24:58.261589 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 11/23] 10.222.0.90 () {64 vars in 1332 bytes} [Mon Feb 21 01:24:58 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:25:00.844222 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-b3d798c4-6316-4cb1-8e49-bf42129c9a0a admin admin] Calling method '>' {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:00.845349 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-b3d798c4-6316-4cb1-8e49-bf42129c9a0a admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002110 Feb 21 01:25:00.845846 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 13/24] 10.222.0.90 () {54 vars in 930 bytes} [Mon Feb 21 01:25:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:25:00.909611 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-68492022-8990-4174-91f6-95fe989398ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small", "swap": 0, "ram": 2048, "disk": 20, "os-flavor-access:is_public": true, "id": "2"}} {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:25:01.164237 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-68492022-8990-4174-91f6-95fe989398ab admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.311015 Feb 21 01:25:01.164753 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 12/25] 10.222.0.90 () {64 vars in 1282 bytes} [Mon Feb 21 01:25:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:01.176270 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-8a572bca-2909-4fcb-9262-2bbc27460d2f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:25:01.276084 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-8a572bca-2909-4fcb-9262-2bbc27460d2f admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103419 Feb 21 01:25:01.276925 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 14/26] 10.222.0.90 () {64 vars in 1332 bytes} [Mon Feb 21 01:25:01 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:25:03.581762 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-68492022-8990-4174-91f6-95fe989398ab admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:03.582694 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-68492022-8990-4174-91f6-95fe989398ab admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Feb 21 01:25:03.583257 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 13/27] 10.222.0.90 () {54 vars in 930 bytes} [Mon Feb 21 01:25:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:25:03.657660 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-c9b76753-f0a1-4684-897a-cccef75d962c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "name": "m1.medium", "ram": 4096, "disk": 40, "id": "3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:25:03.727603 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-c9b76753-f0a1-4684-897a-cccef75d962c admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.137865 Feb 21 01:25:03.735473 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 15/28] 10.222.0.90 () {64 vars in 1282 bytes} [Mon Feb 21 01:25:03 2022] POST /compute/v2.1/flavors => generated 406 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:03.740533 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-4f168c71-6b69-499f-a022-ad2f8952e8a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:25:03.828204 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-4f168c71-6b69-499f-a022-ad2f8952e8a9 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091381 Feb 21 01:25:03.828826 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 14/29] 10.222.0.90 () {64 vars in 1332 bytes} [Mon Feb 21 01:25:03 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:25:06.186457 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-c9b76753-f0a1-4684-897a-cccef75d962c admin admin] Calling method '>' {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:06.187466 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-c9b76753-f0a1-4684-897a-cccef75d962c admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Feb 21 01:25:06.188122 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 16/30] 10.222.0.90 () {54 vars in 930 bytes} [Mon Feb 21 01:25:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:25:06.254890 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-2e7f01bd-bb38-449e-ba97-5b365fb02c43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "id": "4", "vcpus": 4, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.large", "swap": 0}} {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:25:06.329019 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-2e7f01bd-bb38-449e-ba97-5b365fb02c43 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.134169 Feb 21 01:25:06.329699 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 15/31] 10.222.0.90 () {64 vars in 1282 bytes} [Mon Feb 21 01:25:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 01:25:06.343816 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-4cbf4af5-2b56-45bd-aa98-ac357f465875 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:25:06.420355 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-4cbf4af5-2b56-45bd-aa98-ac357f465875 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080138 Feb 21 01:25:06.420893 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 17/32] 10.222.0.90 () {64 vars in 1332 bytes} [Mon Feb 21 01:25:06 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:25:08.837101 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-2e7f01bd-bb38-449e-ba97-5b365fb02c43 admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:08.838118 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-2e7f01bd-bb38-449e-ba97-5b365fb02c43 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Feb 21 01:25:08.843230 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 16/33] 10.222.0.90 () {54 vars in 930 bytes} [Mon Feb 21 01:25:08 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:25:08.900561 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-e5c97ee5-7196-443c-bce9-447ec078335a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160, "id": "5", "vcpus": 8, "ram": 16384, "swap": 0}} {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:25:08.976068 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-e5c97ee5-7196-443c-bce9-447ec078335a admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.131580 Feb 21 01:25:08.977421 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 18/34] 10.222.0.90 () {64 vars in 1282 bytes} [Mon Feb 21 01:25:08 2022] POST /compute/v2.1/flavors => generated 408 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 01:25:08.988710 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-55c787df-d577-4752-be1e-93d01e3aef59 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:25:09.116586 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-55c787df-d577-4752-be1e-93d01e3aef59 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131347 Feb 21 01:25:09.117636 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 17/35] 10.222.0.90 () {64 vars in 1332 bytes} [Mon Feb 21 01:25:08 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:25:31.479120 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-e5c97ee5-7196-443c-bce9-447ec078335a admin admin] Calling method '>' {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:31.480068 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-e5c97ee5-7196-443c-bce9-447ec078335a admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Feb 21 01:25:31.480511 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 19/36] 10.222.0.90 () {54 vars in 930 bytes} [Mon Feb 21 01:25:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:25:31.536581 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-f9066831-9e6d-4d99-8e69-be9873b03bb3 admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:31.553473 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-f9066831-9e6d-4d99-8e69-be9873b03bb3 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067347 Feb 21 01:25:31.554010 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 18/37] 10.222.0.90 () {60 vars in 1291 bytes} [Mon Feb 21 01:25:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:25:32.952726 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-e5c97ee5-7196-443c-bce9-447ec078335a admin admin] Calling method '>' {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:32.953743 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-e5c97ee5-7196-443c-bce9-447ec078335a admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Feb 21 01:25:32.954151 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 20/38] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Feb 21 01:25:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:25:33.154569 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-f232fa2a-7394-4c1f-aa34-00034beabfaf admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:33.159981 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.wsgi [None req-f232fa2a-7394-4c1f-aa34-00034beabfaf admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 21 01:25:33.160522 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-f232fa2a-7394-4c1f-aa34-00034beabfaf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:25:33.161842 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-f232fa2a-7394-4c1f-aa34-00034beabfaf admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057204 Feb 21 01:25:33.162347 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 19/39] 10.222.0.90 () {60 vars in 1190 bytes} [Mon Feb 21 01:25:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 21 01:25:33.171477 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-9f67a1d4-1689-478e-9017-e237f03767a1 admin admin] Calling method '>' {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:33.191481 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-9f67a1d4-1689-478e-9017-e237f03767a1 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023502 Feb 21 01:25:33.192018 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 21/40] 10.222.0.90 () {60 vars in 1210 bytes} [Mon Feb 21 01:25:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:25:33.201623 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-08d78632-2054-4f86-820b-b4aa548ee67c admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:33.222086 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-08d78632-2054-4f86-820b-b4aa548ee67c admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023825 Feb 21 01:25:33.222644 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 20/41] 10.222.0.90 () {60 vars in 1210 bytes} [Mon Feb 21 01:25:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:25:33.232393 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-edcceb0f-e14e-4fb2-a90d-ba08fc2029a7 admin admin] Calling method '>' {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:33.238014 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.wsgi [None req-edcceb0f-e14e-4fb2-a90d-ba08fc2029a7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 21 01:25:33.238573 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-edcceb0f-e14e-4fb2-a90d-ba08fc2029a7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:25:33.239972 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-edcceb0f-e14e-4fb2-a90d-ba08fc2029a7 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010430 Feb 21 01:25:33.240480 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 22/42] 10.222.0.90 () {60 vars in 1190 bytes} [Mon Feb 21 01:25:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 21 01:25:34.493272 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-08d78632-2054-4f86-820b-b4aa548ee67c admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:34.494277 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-08d78632-2054-4f86-820b-b4aa548ee67c admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Feb 21 01:25:34.494672 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 21/43] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Feb 21 01:25:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:25:34.685050 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-122521b7-f510-4353-9ae5-f5fe14ebe2b7 admin admin] Calling method '>' {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:34.690670 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.wsgi [None req-122521b7-f510-4353-9ae5-f5fe14ebe2b7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 21 01:25:34.691225 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-122521b7-f510-4353-9ae5-f5fe14ebe2b7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:25:34.692016 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-122521b7-f510-4353-9ae5-f5fe14ebe2b7 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058608 Feb 21 01:25:34.693150 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 23/44] 10.222.0.90 () {60 vars in 1190 bytes} [Mon Feb 21 01:25:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 21 01:25:34.702390 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-a98a3186-49c5-4260-94cb-5dab2a66f06b admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:34.715648 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-a98a3186-49c5-4260-94cb-5dab2a66f06b admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016818 Feb 21 01:25:34.716185 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 22/45] 10.222.0.90 () {60 vars in 1210 bytes} [Mon Feb 21 01:25:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:25:34.731430 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-ef2c790e-c602-43b7-b2d5-be663cc9a77f admin admin] Calling method '>' {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:34.745311 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-ef2c790e-c602-43b7-b2d5-be663cc9a77f admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017403 Feb 21 01:25:34.745829 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 24/46] 10.222.0.90 () {60 vars in 1210 bytes} [Mon Feb 21 01:25:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:25:34.755323 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-f5a6612c-92e5-40e5-a1dc-13b4d24dc7db admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:34.760486 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.wsgi [None req-f5a6612c-92e5-40e5-a1dc-13b4d24dc7db admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 21 01:25:34.761045 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-f5a6612c-92e5-40e5-a1dc-13b4d24dc7db admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:25:34.761819 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-f5a6612c-92e5-40e5-a1dc-13b4d24dc7db admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010402 Feb 21 01:25:34.762308 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 23/47] 10.222.0.90 () {60 vars in 1190 bytes} [Mon Feb 21 01:25:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Feb 21 01:25:36.029181 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-ef2c790e-c602-43b7-b2d5-be663cc9a77f admin admin] Calling method '>' {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:36.030171 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-ef2c790e-c602-43b7-b2d5-be663cc9a77f admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Feb 21 01:25:36.030560 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 25/48] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Feb 21 01:25:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:25:36.217663 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-e3e34c59-7307-44a0-9187-a9e53abf82db admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:36.222702 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.wsgi [None req-e3e34c59-7307-44a0-9187-a9e53abf82db admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 21 01:25:36.223272 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-e3e34c59-7307-44a0-9187-a9e53abf82db admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:25:36.224581 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-e3e34c59-7307-44a0-9187-a9e53abf82db admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.056340 Feb 21 01:25:36.225079 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 24/49] 10.222.0.90 () {60 vars in 1193 bytes} [Mon Feb 21 01:25:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 21 01:25:36.234122 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-290da85b-d439-4465-aa0d-8831602d78c0 admin admin] Calling method '>' {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:36.248042 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-290da85b-d439-4465-aa0d-8831602d78c0 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017320 Feb 21 01:25:36.248518 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 26/50] 10.222.0.90 () {60 vars in 1210 bytes} [Mon Feb 21 01:25:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:25:36.259135 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-718e84f7-d4b4-42a3-a2d4-aa172f5c5f99 admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:36.271733 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-718e84f7-d4b4-42a3-a2d4-aa172f5c5f99 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017524 Feb 21 01:25:36.272243 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 25/51] 10.222.0.90 () {60 vars in 1210 bytes} [Mon Feb 21 01:25:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:25:36.281151 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-adc71972-719c-40c3-a23e-2a42d0d784ff admin admin] Calling method '>' {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:36.286648 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.wsgi [None req-adc71972-719c-40c3-a23e-2a42d0d784ff admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 21 01:25:36.287190 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-adc71972-719c-40c3-a23e-2a42d0d784ff admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:25:36.287949 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-adc71972-719c-40c3-a23e-2a42d0d784ff admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010247 Feb 21 01:25:36.288445 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 27/52] 10.222.0.90 () {60 vars in 1193 bytes} [Mon Feb 21 01:25:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 21 01:25:37.552070 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-718e84f7-d4b4-42a3-a2d4-aa172f5c5f99 admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:37.555450 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-718e84f7-d4b4-42a3-a2d4-aa172f5c5f99 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Feb 21 01:25:37.555450 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 26/53] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Feb 21 01:25:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:25:37.751326 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-6c4ebfb7-0d83-4cd1-9bb6-967d6a9e1590 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:25:37.819344 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-6c4ebfb7-0d83-4cd1-9bb6-967d6a9e1590 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.119088 Feb 21 01:25:37.819821 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 28/54] 10.222.0.90 () {64 vars in 1235 bytes} [Mon Feb 21 01:25:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:39.102892 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-718e84f7-d4b4-42a3-a2d4-aa172f5c5f99 admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:39.103872 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-718e84f7-d4b4-42a3-a2d4-aa172f5c5f99 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001390 Feb 21 01:25:39.104265 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 27/55] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Feb 21 01:25:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:25:39.293182 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-d21f04e0-f4a2-41a1-8ee3-f3c7c8dc227f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:25:39.361003 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-d21f04e0-f4a2-41a1-8ee3-f3c7c8dc227f admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.117543 Feb 21 01:25:39.361559 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 29/56] 10.222.0.90 () {64 vars in 1235 bytes} [Mon Feb 21 01:25:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 01:25:40.616676 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-718e84f7-d4b4-42a3-a2d4-aa172f5c5f99 admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:40.617737 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-718e84f7-d4b4-42a3-a2d4-aa172f5c5f99 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Feb 21 01:25:40.618609 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 28/57] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Feb 21 01:25:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:25:40.806931 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-4379da08-cd9b-4164-b3b4-e35543e20e1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:25:40.903769 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-4379da08-cd9b-4164-b3b4-e35543e20e1c admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.147156 Feb 21 01:25:40.904308 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 30/58] 10.222.0.90 () {64 vars in 1235 bytes} [Mon Feb 21 01:25:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:42.191851 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-718e84f7-d4b4-42a3-a2d4-aa172f5c5f99 admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:42.193411 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-718e84f7-d4b4-42a3-a2d4-aa172f5c5f99 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001966 Feb 21 01:25:42.193801 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 29/59] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Feb 21 01:25:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:25:42.401459 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-b0cfcc62-2839-4169-9f3b-bfd36bd035c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:25:42.522992 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-b0cfcc62-2839-4169-9f3b-bfd36bd035c4 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.191781 Feb 21 01:25:42.523555 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 31/60] 10.222.0.90 () {64 vars in 1235 bytes} [Mon Feb 21 01:25:42 2022] POST /compute/v2.1/flavors => generated 409 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:25:43.821808 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-718e84f7-d4b4-42a3-a2d4-aa172f5c5f99 admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:43.822796 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-718e84f7-d4b4-42a3-a2d4-aa172f5c5f99 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Feb 21 01:25:43.823221 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 30/61] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Feb 21 01:25:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:25:44.014489 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-3f3c9aed-c331-4067-a25c-22820de8075f admin admin] Calling method '>' {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:25:44.033156 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-3f3c9aed-c331-4067-a25c-22820de8075f admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.068798 Feb 21 01:25:44.033690 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 32/62] 10.222.0.90 () {60 vars in 1202 bytes} [Mon Feb 21 01:25:43 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:26:34.589100 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-718e84f7-d4b4-42a3-a2d4-aa172f5c5f99 admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:26:34.590138 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-718e84f7-d4b4-42a3-a2d4-aa172f5c5f99 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Feb 21 01:26:34.590734 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 31/63] 10.222.0.90 () {54 vars in 930 bytes} [Mon Feb 21 01:26:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:26:34.648007 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-de675a6a-bae9-4788-9d45-769b142296eb admin admin] Calling method '>' {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:26:34.667262 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-de675a6a-bae9-4788-9d45-769b142296eb admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070933 Feb 21 01:26:34.667801 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 33/64] 10.222.0.90 () {60 vars in 1291 bytes} [Mon Feb 21 01:26:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:26:34.690223 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-3195cabf-9162-4518-aac5-499f72214928 admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:26:34.698038 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-3195cabf-9162-4518-aac5-499f72214928 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011422 Feb 21 01:26:34.698596 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 32/65] 10.222.0.90 () {60 vars in 1282 bytes} [Mon Feb 21 01:26:34 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:26:34.709737 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-08fcfc60-674d-42c5-b530-3d0738f57340 admin admin] Calling method '>' {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:26:34.717160 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-08fcfc60-674d-42c5-b530-3d0738f57340 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011080 Feb 21 01:26:34.717732 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 34/66] 10.222.0.90 () {60 vars in 1285 bytes} [Mon Feb 21 01:26:34 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:26:34.728833 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-653d9010-3d6d-4eee-b4ce-3b148e4cfb60 admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:26:34.736338 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-653d9010-3d6d-4eee-b4ce-3b148e4cfb60 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010911 Feb 21 01:26:34.736881 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 33/67] 10.222.0.90 () {60 vars in 1285 bytes} [Mon Feb 21 01:26:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:26:34.748100 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-bec55117-fba2-460b-8494-7debd6ea706a admin admin] Calling method '>' {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:26:34.755767 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-bec55117-fba2-460b-8494-7debd6ea706a admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011061 Feb 21 01:26:34.756276 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 35/68] 10.222.0.90 () {60 vars in 1282 bytes} [Mon Feb 21 01:26:34 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:28:23.982452 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-4a51d21e-3612-4d4e-af0a-4615f2d3b5c8 tempest-verify_tempest_config-2089354565 tempest-verify_tempest_config-2089354565-project] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:28:23.984395 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-4a51d21e-3612-4d4e-af0a-4615f2d3b5c8 tempest-verify_tempest_config-2089354565 tempest-verify_tempest_config-2089354565-project] 10.222.0.90 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.107145 Feb 21 01:28:23.984965 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 34/69] 10.222.0.90 () {58 vars in 1133 bytes} [Mon Feb 21 01:28:23 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:30:01.758446 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-bec55117-fba2-460b-8494-7debd6ea706a admin admin] Calling method '>' {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:01.759448 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-bec55117-fba2-460b-8494-7debd6ea706a admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Feb 21 01:30:01.759857 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 36/70] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Feb 21 01:30:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:30:02.012339 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-39fdb92d-8b9e-4a2b-a954-e288437833bc admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:02.013554 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:30:02.013554 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: warnings.warn(msg) Feb 21 01:30:02.015115 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG oslo_concurrency.lockutils [None req-39fdb92d-8b9e-4a2b-a954-e288437833bc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:02.015558 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG oslo_concurrency.lockutils [None req-39fdb92d-8b9e-4a2b-a954-e288437833bc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:02.016354 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG oslo_concurrency.lockutils [None req-39fdb92d-8b9e-4a2b-a954-e288437833bc admin admin] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:02.016841 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG oslo_concurrency.lockutils [None req-39fdb92d-8b9e-4a2b-a954-e288437833bc admin admin] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:02.050453 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-39fdb92d-8b9e-4a2b-a954-e288437833bc admin admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.148050 Feb 21 01:30:02.051038 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 35/71] 10.222.0.90 () {60 vars in 1193 bytes} [Mon Feb 21 01:30:01 2022] GET /compute/v2.1/os-services => generated 791 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:30:03.322132 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-bec55117-fba2-460b-8494-7debd6ea706a admin admin] Calling method '>' {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:03.323128 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-bec55117-fba2-460b-8494-7debd6ea706a admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Feb 21 01:30:03.323530 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 37/72] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Feb 21 01:30:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:30:03.515165 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-e26a336a-bd35-4906-8fac-67dc7b4f498a admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:03.516512 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:30:03.516512 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: warnings.warn(msg) Feb 21 01:30:03.518664 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG oslo_concurrency.lockutils [None req-e26a336a-bd35-4906-8fac-67dc7b4f498a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:03.519133 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG oslo_concurrency.lockutils [None req-e26a336a-bd35-4906-8fac-67dc7b4f498a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:03.520014 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG oslo_concurrency.lockutils [None req-e26a336a-bd35-4906-8fac-67dc7b4f498a admin admin] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:03.520468 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG oslo_concurrency.lockutils [None req-e26a336a-bd35-4906-8fac-67dc7b4f498a admin admin] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:03.539059 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-e26a336a-bd35-4906-8fac-67dc7b4f498a admin admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074831 Feb 21 01:30:03.539545 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 36/73] 10.222.0.90 () {60 vars in 1193 bytes} [Mon Feb 21 01:30:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:30:15.242617 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-bec55117-fba2-460b-8494-7debd6ea706a admin admin] Calling method '>' {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:15.243613 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-bec55117-fba2-460b-8494-7debd6ea706a admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Feb 21 01:30:15.244014 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 38/74] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Feb 21 01:30:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:30:15.435750 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-b28d627d-f026-4aa4-bbb6-13ab89f9c04e admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:15.436936 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:30:15.436936 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: warnings.warn(msg) Feb 21 01:30:15.438473 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG oslo_concurrency.lockutils [None req-b28d627d-f026-4aa4-bbb6-13ab89f9c04e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:15.438916 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG oslo_concurrency.lockutils [None req-b28d627d-f026-4aa4-bbb6-13ab89f9c04e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:15.439707 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG oslo_concurrency.lockutils [None req-b28d627d-f026-4aa4-bbb6-13ab89f9c04e admin admin] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:15.440133 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG oslo_concurrency.lockutils [None req-b28d627d-f026-4aa4-bbb6-13ab89f9c04e admin admin] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:15.465340 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-b28d627d-f026-4aa4-bbb6-13ab89f9c04e admin admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079753 Feb 21 01:30:15.465836 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 37/75] 10.222.0.90 () {60 vars in 1193 bytes} [Mon Feb 21 01:30:15 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:30:16.752782 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: DEBUG nova.api.openstack.wsgi [None req-bec55117-fba2-460b-8494-7debd6ea706a admin admin] Calling method '>' {{(pid=102415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:16.753748 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: INFO nova.api.openstack.requestlog [None req-bec55117-fba2-460b-8494-7debd6ea706a admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Feb 21 01:30:16.754161 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: [pid: 102415|app: 0|req: 39/76] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Feb 21 01:30:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:30:16.957017 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG nova.api.openstack.wsgi [None req-6b081332-0fb4-4e57-9887-b4cfc72ff0e2 admin admin] Calling method '>' {{(pid=102416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:30:16.958487 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:30:16.958487 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: warnings.warn(msg) Feb 21 01:30:16.960448 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG oslo_concurrency.lockutils [None req-6b081332-0fb4-4e57-9887-b4cfc72ff0e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:16.960889 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG oslo_concurrency.lockutils [None req-6b081332-0fb4-4e57-9887-b4cfc72ff0e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:16.961923 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG oslo_concurrency.lockutils [None req-6b081332-0fb4-4e57-9887-b4cfc72ff0e2 admin admin] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:30:16.962511 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: DEBUG oslo_concurrency.lockutils [None req-6b081332-0fb4-4e57-9887-b4cfc72ff0e2 admin admin] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:30:16.983853 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: INFO nova.api.openstack.requestlog [None req-6b081332-0fb4-4e57-9887-b4cfc72ff0e2 admin admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086910 Feb 21 01:30:16.984604 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: [pid: 102416|app: 0|req: 38/77] 10.222.0.90 () {60 vars in 1193 bytes} [Mon Feb 21 01:30:16 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:31:15.000311 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: Mon Feb 21 01:31:15 2022 - graceful shutdown triggered... Feb 21 01:31:15.000542 dv-cinder-813228-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 21 01:31:15.001291 dv-cinder-813228-6-iscsi devstack@n-api.service[102416]: Gracefully killing worker 2 (pid: 102416)... Feb 21 01:31:15.001661 dv-cinder-813228-6-iscsi devstack@n-api.service[102415]: Gracefully killing worker 1 (pid: 102415)... Feb 21 01:31:16.002305 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: worker 1 buried after 1 seconds Feb 21 01:31:16.002305 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: worker 2 buried after 1 seconds Feb 21 01:31:16.002305 dv-cinder-813228-6-iscsi devstack@n-api.service[102414]: goodbye to uWSGI. Feb 21 01:31:16.003896 dv-cinder-813228-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Feb 21 01:31:16.004471 dv-cinder-813228-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 21 01:31:16.007515 dv-cinder-813228-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 21 01:31:16.024821 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 21 01:31:16.040864 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 21 01:31:16 2022] *** Feb 21 01:31:16.040864 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 21 01:31:16.040864 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 21 01:31:16.040864 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: nodename: dv-cinder-813228-6-iscsi Feb 21 01:31:16.040864 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: machine: x86_64 Feb 21 01:31:16.040864 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: clock source: unix Feb 21 01:31:16.040864 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: pcre jit disabled Feb 21 01:31:16.040864 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: detected number of CPU cores: 4 Feb 21 01:31:16.040864 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: current working directory: / Feb 21 01:31:16.040864 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: detected binary path: /usr/bin/uwsgi-core Feb 21 01:31:16.041662 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: your processes number limit is 47680 Feb 21 01:31:16.041662 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: your memory page size is 4096 bytes Feb 21 01:31:16.041662 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: detected max file descriptor number: 2048 Feb 21 01:31:16.041662 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: lock engine: pthread robust mutexes Feb 21 01:31:16.041662 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: thunder lock: enabled Feb 21 01:31:16.041662 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 21 01:31:16.041662 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 21 01:31:16.088773 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: Python main interpreter initialized at 0x55557d7469c0 Feb 21 01:31:16.088773 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: python threads support enabled Feb 21 01:31:16.088773 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: your server socket listen backlog is limited to 100 connections Feb 21 01:31:16.088773 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: your mercy for graceful operations on workers is 90 seconds Feb 21 01:31:16.089219 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: mapped 403077 bytes (393 KB) for 2 cores Feb 21 01:31:16.089219 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: *** Operational MODE: preforking *** Feb 21 01:31:16.089486 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: *** uWSGI is running in multiple interpreter mode *** Feb 21 01:31:16.089486 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: spawned uWSGI master process (pid: 123524) Feb 21 01:31:16.089690 dv-cinder-813228-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 21 01:31:16.096477 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: spawned uWSGI worker 1 (pid: 123541, cores: 1) Feb 21 01:31:16.096477 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: spawned uWSGI worker 2 (pid: 123542, cores: 1) Feb 21 01:31:16.096477 dv-cinder-813228-6-iscsi devstack@n-api.service[123524]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 21 01:31:18.031824 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 01:31:18.031824 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: from cryptography.utils import int_from_bytes Feb 21 01:31:18.032550 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 01:31:18.032550 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: from cryptography.utils import int_from_bytes Feb 21 01:31:18.033125 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 01:31:18.033125 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: from cryptography.utils import int_from_bytes Feb 21 01:31:18.033611 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 01:31:18.033611 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: from cryptography.utils import int_from_bytes Feb 21 01:31:20.464199 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 01:31:20.464890 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 01:31:20.464981 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 01:31:20.465349 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 01:31:20.465596 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 01:31:20.465988 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.466317 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.466639 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.466958 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.467291 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.467603 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.467948 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.468277 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.468655 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.468916 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.469234 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.469566 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813228-6-iscsi {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.469781 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 01:31:20.470193 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.470277 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 01:31:20.470359 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.470581 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.470694 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 01:31:20.470841 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.470941 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 01:31:20.471093 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.471185 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 01:31:20.471425 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.471534 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.471726 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.471823 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.472158 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.472270 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.472528 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.472715 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.472880 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.472979 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.473173 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.473375 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.473537 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.473721 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.473883 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.474073 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.474228 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.474387 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.474551 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.474698 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.474842 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.474992 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.475152 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813228-6-iscsi {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.475305 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.475469 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.475625 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.475808 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.475980 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.476150 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813228-6-iscsi {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.476304 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.476480 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.476668 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.476847 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.477008 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.477153 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.477302 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.477452 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.477597 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.477747 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.477919 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.478064 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.478207 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.478367 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.478557 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.478720 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.478866 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.479016 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.479167 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.479327 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.479481 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.479713 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.479900 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.480056 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.480211 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.480376 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.480554 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.480715 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.480895 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.481050 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.481202 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.481395 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813228-6-iscsi {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.481571 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.481730 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.481876 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.482052 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.482241 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.482241 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.483104 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.483258 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.483402 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.484102 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.484254 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.484414 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.484604 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.484748 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.484946 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.485108 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.485255 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.485408 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.485577 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.485730 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.485876 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.486020 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.486173 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.486327 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.486479 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.486659 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.486813 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.486957 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.487115 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.487269 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.487431 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.487582 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.487733 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.487886 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.488046 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.488223 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.488381 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.488561 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.488714 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.488875 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.489062 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.489217 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.489363 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.489524 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.489675 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.489833 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.489984 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.490169 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.490325 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.490474 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.490632 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.490632 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.490924 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.490924 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.491214 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.491214 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.491507 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.491659 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.491804 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.491947 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.492097 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.492247 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.492404 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.493212 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.493378 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.493534 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.493680 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.493841 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.494002 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.494154 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.494298 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.494448 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.494603 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.494763 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.494917 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.495079 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.495226 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.495226 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.495515 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.495674 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.495837 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.495993 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.496147 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.496325 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.496490 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.496701 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.496865 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.497010 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.497187 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.497334 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.497478 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.497636 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.497800 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.497945 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.498095 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.498271 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.498425 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.498584 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.498729 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.498881 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.499025 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.499229 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.499960 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.500118 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.500273 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.500457 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.500618 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.500770 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.500770 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.501056 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.501209 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.501354 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.501354 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.501657 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.501802 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.501953 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.502106 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.502258 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.502491 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.502639 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.503503 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.503652 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.503797 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.503956 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.504114 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.504258 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.504467 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.504636 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.504783 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.504935 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.505090 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.505279 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.505428 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.505586 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.505739 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.505891 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.506043 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.506196 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.506593 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.506754 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.506900 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.507052 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.507197 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.507350 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.507506 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.507662 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.507807 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.507951 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.508095 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.508246 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.508402 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.508570 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.508724 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.508869 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.509019 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.509164 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.509333 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.509479 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.509630 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.509791 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.509937 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.510087 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.510238 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.510391 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.510543 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.510700 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.510845 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.510996 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.511140 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.511294 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.511445 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.511598 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.511750 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.511902 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.512053 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.512197 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.512355 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.512554 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.512711 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.513523 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.513689 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.513843 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.514012 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.514164 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.514340 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.514487 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.514641 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.514812 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.514981 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.515129 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.515280 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.515425 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.515569 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.515713 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.515889 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.516035 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.516186 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.516331 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.516527 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.516695 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.516841 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.516995 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.517151 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.517302 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.517457 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.517611 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.517756 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.517921 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.518066 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.518209 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.518362 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.518516 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.518669 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 01:31:20.518855 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.519003 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.519147 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.519299 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.519452 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.519598 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.519749 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.519912 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.520058 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.520210 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.520356 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.520565 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.520723 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.520877 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.521036 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.521195 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.521388 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.521545 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.521692 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.521849 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.521994 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.522138 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.522365 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.522512 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.522656 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.522807 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.522969 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.523757 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.523919 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.524075 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.524228 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.524387 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.524601 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.524748 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.524916 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.525066 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.525210 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.525353 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.525496 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.525654 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.525798 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.525942 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.526087 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.526238 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.526390 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.526559 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.526705 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.526858 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.527010 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.527163 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.527324 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.527483 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.527642 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.527786 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.527945 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.528171 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.528319 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.528509 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.528660 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.528811 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.528962 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.529113 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.529271 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.529271 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.529556 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.529700 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.529844 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.529988 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.530204 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.530395 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.530594 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.530747 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.530891 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.531042 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.531201 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.531354 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.531499 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.531644 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.531793 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.531939 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.532092 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.532243 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.532389 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.532588 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.532735 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.532889 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.533041 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.533621 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.534106 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.534266 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.534420 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.534580 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.534726 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.534918 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.535067 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.535212 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.535375 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.535529 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.535674 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.535826 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.535977 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.536128 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.536273 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.536452 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.536745 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.536895 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.537048 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.537200 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.537351 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.537550 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.537700 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.537845 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.537998 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.538142 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.538299 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.538444 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.538588 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.538733 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.538884 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.539029 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.539182 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.539413 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.539568 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.539722 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.539866 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.540017 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.540175 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.540327 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.540524 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.540675 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.540821 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.540965 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.541128 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.541273 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.541434 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.541580 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.541724 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.541724 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.542008 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.542153 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.542297 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.542448 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.542604 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.542763 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.542917 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.543062 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.543206 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.543809 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.544252 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.544415 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.544598 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.544745 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.544907 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.545061 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.545284 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.545284 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.545578 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.545731 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.545875 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.546612 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.546776 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.546930 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.547084 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.547235 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.547386 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.547531 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.547687 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.547840 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.547992 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.548148 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.548293 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.548481 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.548658 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.548811 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.548955 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.549107 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.549312 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.549534 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.549690 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.549843 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.549996 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.550141 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.550292 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.550451 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.550604 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.550768 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.550958 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.551121 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.551274 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.551428 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.551580 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.551732 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.551885 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.552030 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.552173 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.552328 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.552490 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.552640 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.552826 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.552987 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.553140 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.553294 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.553465 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.554069 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.554497 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.554658 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.554818 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.554963 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.555116 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.555267 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.555426 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.555583 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.555738 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.555882 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.556034 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.556188 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.556339 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.556562 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.556725 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.556871 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.557033 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.557179 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.557329 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.557591 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.557759 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.557911 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.558064 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.558215 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.558373 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.558532 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.558758 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.558915 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.559060 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.559211 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.559356 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.559508 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.559671 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.559816 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.559968 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.560121 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.560274 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.560450 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.560685 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.560846 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.560992 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.561137 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.561293 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.561454 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.561601 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.562293 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.562442 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.562586 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.562774 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.563001 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.563156 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.563309 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.563466 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.563623 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.564209 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.564482 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.564744 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.564983 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.565144 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.565294 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.565521 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.565689 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.565689 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.565999 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.566158 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.566310 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.566470 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.566622 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.566773 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.566923 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.567082 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.567252 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.567417 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.567570 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.567721 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.567878 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.568030 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.568189 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.568340 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.568617 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.568773 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.568960 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.569124 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.569285 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.569459 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.569610 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.569774 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.569925 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.570111 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.570283 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.570283 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.570283 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.570714 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.570873 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.571031 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.571194 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.571364 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.571524 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.571683 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.571835 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.571995 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.572155 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.572307 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.572475 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.572642 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.572802 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.572968 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.573133 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.573285 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.573453 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.573614 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.573773 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.574380 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.574636 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.574912 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.575184 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.575352 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.575504 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.575666 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.575818 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.575976 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.576128 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.576128 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.576128 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.576619 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.576771 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.576921 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.577072 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.577234 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.577428 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.577591 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.577743 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.577910 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.578070 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.578222 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.578398 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.578551 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.578702 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.578853 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.579005 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.579155 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.579315 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.579466 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.579618 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.579768 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.579932 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.580096 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.580266 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.580444 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.580604 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.580767 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.580918 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.581084 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.581236 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.581394 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.581553 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.581553 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.581842 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.582008 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.582171 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.582332 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.582484 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.582643 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.582807 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.582968 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.583172 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.583324 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.583481 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.583640 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.583802 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.584520 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.584777 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.585071 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.585349 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.585508 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.585675 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.585829 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.585989 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.586178 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.586347 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.586499 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.586657 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.586817 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.586977 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.587137 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.587302 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.587302 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.587610 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.587762 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.587922 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.588082 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.588234 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.588398 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.588573 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.588725 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.588890 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.589052 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.589052 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.589358 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.589518 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.589669 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.589827 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.589993 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.590145 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.590304 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.590455 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.590614 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.590779 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.590938 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.591091 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.591241 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.591411 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.591570 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.591723 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.591874 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.592024 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.592183 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.592406 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.592594 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.592755 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.593432 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.593600 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.593753 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.593914 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.594094 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.594629 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.594884 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.595049 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.595315 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.595574 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.595738 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.595897 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.596048 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.596198 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.596359 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.596568 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.596743 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.596904 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.597120 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.597275 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.597437 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.597589 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.597740 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.597893 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.598044 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.598196 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.598355 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.598515 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.598680 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.598842 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.598995 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.599156 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.599316 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.599477 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.599637 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.599790 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.599940 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.600104 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.600256 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.600409 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.600585 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.600736 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.600909 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.601071 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.601224 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.601323 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.601398 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.601521 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.601668 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.601799 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.601936 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.602075 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.602206 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.602335 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.602335 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.602603 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.602603 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.602858 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.602858 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.603101 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.603244 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.603374 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.603511 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.603643 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.603780 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.603910 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.604048 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.604187 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.604332 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.604883 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.605090 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.605234 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.605461 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.605617 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.605883 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.606025 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.606164 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.606308 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.606446 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.606577 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.606714 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.606847 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.606984 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.607124 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.607263 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.607406 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.607546 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.607676 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.607805 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.607952 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.608091 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.608230 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.608360 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.608572 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.609218 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.609351 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.609502 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.610148 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.610298 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.610444 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.610596 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.610728 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.610866 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.611006 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.611136 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.611265 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.611404 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.611534 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.611671 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.611801 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.611941 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.612072 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.612212 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.612342 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.612500 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.612634 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.612764 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.612894 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.613027 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.613151 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.613266 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.613266 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.613478 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.613478 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.613478 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.613478 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.613891 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.614009 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.614009 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.614239 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.614353 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.614353 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.615001 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.615229 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.615229 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.615470 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.615591 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.615591 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.615841 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.616063 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.616297 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.616474 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.616618 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.616758 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.616758 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.617047 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.617193 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.617325 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.617454 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.617454 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.617707 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.617836 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.617985 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.618115 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.618115 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.618390 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.618520 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.618520 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.618783 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.619504 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.619640 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.619779 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.619779 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.620050 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.620181 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.620311 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.620508 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.620508 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.620770 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.620902 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.621042 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.621181 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.621181 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.621441 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.621586 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.621586 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.621845 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.621974 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.621974 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.622225 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.622433 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.622433 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.622433 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.622433 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.622433 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.622433 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.622433 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.622433 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.623417 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.623417 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.623417 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.623417 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.623417 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.623417 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.623417 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.623417 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.624401 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.624401 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.624401 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.624401 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.624401 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.625538 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.625682 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.625832 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.625971 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.625971 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.626342 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.626558 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.626702 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.626872 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.626872 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.627120 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.627251 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.627251 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.627512 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.627656 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.627656 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.627911 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.628047 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.628185 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.628329 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.628329 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.628656 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.628795 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.628795 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.629040 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.629179 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.629179 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.629433 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.629562 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.629697 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.629827 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.629966 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.630097 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.630097 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.630357 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.630487 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.630487 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.630741 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.630881 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.630881 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.630881 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.631258 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.631660 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.631800 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.631935 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.631935 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.632187 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.632315 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.632315 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.632315 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.632315 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.632840 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.632969 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.632969 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.633219 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.633348 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.633348 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.633588 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.633714 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.633714 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.633972 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.634100 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.634100 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.634339 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.634475 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.634614 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.634750 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.634750 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.635419 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.635622 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.635622 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.635885 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.636015 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.636156 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.636393 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.636393 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.636884 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.637028 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.637169 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.637309 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.637440 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.637576 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.637576 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.637836 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.637965 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.637965 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.638226 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.638367 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.638367 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.638634 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.638765 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.638765 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.639031 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.639170 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.639302 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.639439 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.639439 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.639682 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.639848 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.639848 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.640111 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.640248 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.640248 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.640528 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.640670 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.640801 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.640940 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.641072 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.641200 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.641402 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.641614 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.641762 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.642033 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.642164 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.642351 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.642534 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.642751 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.642962 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.643102 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.643276 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.643569 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.643712 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.643926 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.644065 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.644252 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.644520 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.644659 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.644941 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.645466 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.645627 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.645830 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.645971 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.646102 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.646246 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.646396 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.646614 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.646777 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.646992 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.647124 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.647299 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.647430 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.647671 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.647805 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.648031 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.648171 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.648343 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.648612 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.648756 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.648997 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.649161 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.649305 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.649531 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.649670 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.649901 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.650031 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.650230 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.650461 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.650595 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.650856 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.650988 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.651172 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.651380 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.651523 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.651783 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.651928 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.652092 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.652314 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.652486 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.652761 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.652901 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.653108 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.653264 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.653438 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.653771 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.653911 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.654108 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.654301 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.654441 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.654740 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.654882 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.655065 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.655346 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.656297 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.657245 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.657387 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.657519 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.657736 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.657878 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.658010 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.658010 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.658256 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.658386 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.658524 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.658669 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.658669 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.659023 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.659156 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.659156 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.659449 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.659595 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.659753 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.659892 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.660024 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.660153 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.660299 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.660489 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.660634 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.660881 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.661015 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.661249 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.661399 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.661530 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.661801 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.661942 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.662119 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.662302 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.662446 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.662737 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.662870 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.663072 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.663239 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.663404 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.663696 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.663838 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.664064 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.664203 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.664389 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.664652 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.664788 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.665064 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.665204 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.665487 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.665705 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.665838 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.666008 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.666505 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.666505 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.666755 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.666898 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.667028 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.667172 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.667492 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.667632 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.667874 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.668197 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.670789 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.670789 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.671659 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.671782 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.671872 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.671966 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.671966 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.672136 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.672221 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.672313 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.672406 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.672519 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.672604 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.672678 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.672776 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.672776 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.672938 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.672938 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.673069 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.673069 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.673318 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.673783 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.673978 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.674308 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.674635 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.674812 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.674970 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.675286 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.675489 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.675659 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.675815 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.675967 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.676126 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.676326 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.676565 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.676724 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.676873 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.677028 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.677196 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.677353 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.677762 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.677917 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.678061 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.678201 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.678348 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.678507 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.678653 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.678653 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.678933 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.679077 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.679253 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.679404 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.679555 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.679703 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.679845 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.679985 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.680141 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.680284 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.680456 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.680604 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.680707 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.680795 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.680895 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.680982 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.681196 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.681326 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.681514 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.681710 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.681840 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.681946 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.682159 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.682261 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.682473 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.682578 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.682787 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.682881 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.683106 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.683207 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.683424 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.683531 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.683762 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.683863 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.684079 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.684233 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.684396 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.684578 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.684754 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.684888 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.685068 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.685170 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.685382 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.685486 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.685696 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.685790 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.686013 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.686112 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.686323 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.686428 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.686654 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.686753 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.686973 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.687066 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.687283 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.687385 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.687612 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.687899 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.688058 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.688220 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.688326 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.688565 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.688675 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.688883 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.688976 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.689192 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.689364 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.689506 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.689608 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.689822 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.689921 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.690135 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.690229 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.690448 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.690542 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.690761 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.690854 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.691072 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.691173 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.691387 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.691479 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.691716 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.691816 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.692031 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.692124 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.692348 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.692455 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.692706 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.692811 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.693026 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.693119 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.693347 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.693570 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.693664 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.693911 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.694013 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.694239 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.694332 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.694579 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.694681 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.694918 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.695017 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.695229 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.695321 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.695543 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.695645 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.695854 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.695954 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.696167 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.696268 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.696526 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.696638 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.696847 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.696944 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.697166 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.697260 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.697486 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.697592 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.697838 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.698001 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.698197 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.698331 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.698431 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.698526 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.698714 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.698821 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.699031 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.699127 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.699348 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.699484 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.699665 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.699794 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.699987 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.700108 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.700331 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.700546 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.700686 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.700866 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.701009 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.701203 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.701325 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.701531 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.701651 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.701864 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.701985 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.702184 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.702325 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.702531 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.702651 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.702861 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.702981 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.703169 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.703292 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.703475 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.703571 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.703786 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.703888 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.704095 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.704189 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.704402 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.704562 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.704867 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.704991 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.705188 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.705298 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.705496 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.705606 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.705820 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.705942 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.706125 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.706220 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.706465 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.706662 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.706807 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.707014 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.707153 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.707333 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.707468 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.707660 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.707767 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.707991 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.708105 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.708307 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.708467 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.708767 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.708911 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.709030 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.709153 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.709344 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.709468 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.709813 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.709931 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.710031 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.710117 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.710267 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.710412 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.710564 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.710660 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.710873 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.710973 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.711182 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.711277 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.711492 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.711587 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.711803 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.711898 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.712114 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.712208 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.712417 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.712562 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.712771 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.712865 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.713080 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.713183 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.713388 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.713484 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.713698 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.713792 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.714010 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.714119 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.714317 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.714429 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.714621 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.714715 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.714929 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.715041 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.715235 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.715329 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.715546 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.715646 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.715853 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.715956 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.716162 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.716255 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.716486 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.716584 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.716799 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.716907 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.717106 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.717211 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.717415 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.717509 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.717772 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.717866 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.718631 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.718768 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.719001 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.719169 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.719326 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.719484 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.719587 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.719805 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.719899 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.720119 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.720229 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.720500 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.720616 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.720819 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.720926 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.721140 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.721243 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.721474 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.721569 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.721796 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.721888 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.722133 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.722334 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.722468 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.722670 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.722821 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.722991 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.723144 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.723325 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.723498 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.723655 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.723831 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.723963 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.724160 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.724263 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.724503 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.724601 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.724820 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.724923 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.725069 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 01:31:20.725756 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.726072 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.726387 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.726702 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.727015 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.727329 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.727642 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.727953 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.728264 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.728599 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.728921 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.729226 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.729566 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.729884 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.730200 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.730519 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.730836 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.731148 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.731459 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.731769 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.732080 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.732400 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.732752 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.733067 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.733373 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.734350 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.734664 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.734985 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.735306 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.735620 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.735945 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.736272 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.736613 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.736931 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.737245 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.737576 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.737919 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.738250 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.738577 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.738901 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.739230 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.739488 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.739798 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.740130 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.740498 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.740817 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.741143 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.741455 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.741778 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.742090 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.742421 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.742745 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.743065 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.743378 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.743711 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.744021 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.744333 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.744670 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.744983 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.745287 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.745596 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.745922 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.746247 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.746555 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.746946 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.747200 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.747523 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.747826 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.748137 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.748486 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.748706 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_db.sqlalchemy.engines [None req-22df8dc7-4b59-4e14-aee4-7667a19396a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:31:20.748808 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.749102 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.749450 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.749760 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.750072 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.750388 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.750704 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.751034 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.751363 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.751703 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.752019 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.752372 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.752712 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.753060 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.753389 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.753705 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.754017 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.754323 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 01:31:20.754567 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 01:31:20.776986 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_db.sqlalchemy.engines [None req-38f43cff-8fcd-4ded-9d4a-36e7589bb02a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:31:20.813662 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.context [None req-22df8dc7-4b59-4e14-aee4-7667a19396a2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cee51e8e-7ef6-449d-9af5-b8ee4b8e6645(cell1) {{(pid=123542) load_cells /opt/stack/nova/nova/context.py:464}} Feb 21 01:31:20.817940 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22df8dc7-4b59-4e14-aee4-7667a19396a2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:20.819529 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22df8dc7-4b59-4e14-aee4-7667a19396a2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:20.820354 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22df8dc7-4b59-4e14-aee4-7667a19396a2 None None] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:20.822321 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22df8dc7-4b59-4e14-aee4-7667a19396a2 None None] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:20.832990 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_db.sqlalchemy.engines [None req-22df8dc7-4b59-4e14-aee4-7667a19396a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:31:20.834449 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_db.sqlalchemy.engines [None req-22df8dc7-4b59-4e14-aee4-7667a19396a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:31:20.840256 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.context [None req-38f43cff-8fcd-4ded-9d4a-36e7589bb02a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cee51e8e-7ef6-449d-9af5-b8ee4b8e6645(cell1) {{(pid=123541) load_cells /opt/stack/nova/nova/context.py:464}} Feb 21 01:31:20.845071 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38f43cff-8fcd-4ded-9d4a-36e7589bb02a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:20.846654 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38f43cff-8fcd-4ded-9d4a-36e7589bb02a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:20.847464 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38f43cff-8fcd-4ded-9d4a-36e7589bb02a None None] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:31:20.849424 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38f43cff-8fcd-4ded-9d4a-36e7589bb02a None None] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:31:20.860775 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_db.sqlalchemy.engines [None req-38f43cff-8fcd-4ded-9d4a-36e7589bb02a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:31:20.861668 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_db.sqlalchemy.engines [None req-38f43cff-8fcd-4ded-9d4a-36e7589bb02a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:31:20.996229 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_db.sqlalchemy.engines [None req-22df8dc7-4b59-4e14-aee4-7667a19396a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:31:21.018037 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_db.sqlalchemy.engines [None req-38f43cff-8fcd-4ded-9d4a-36e7589bb02a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 01:31:21.336326 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: WARNING keystonemiddleware.auth_token [None req-22df8dc7-4b59-4e14-aee4-7667a19396a2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 01:31:21.343179 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: WARNING keystonemiddleware.auth_token [None req-22df8dc7-4b59-4e14-aee4-7667a19396a2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 01:31:21.344046 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: WARNING keystonemiddleware.auth_token [None req-38f43cff-8fcd-4ded-9d4a-36e7589bb02a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 01:31:21.350687 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: WARNING keystonemiddleware.auth_token [None req-38f43cff-8fcd-4ded-9d4a-36e7589bb02a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 01:31:21.704059 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: WARNING keystonemiddleware.auth_token [None req-38f43cff-8fcd-4ded-9d4a-36e7589bb02a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 01:31:21.709286 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: WARNING keystonemiddleware.auth_token [None req-38f43cff-8fcd-4ded-9d4a-36e7589bb02a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 01:31:21.714663 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55557d7469c0 pid: 123541 (default app) Feb 21 01:31:21.718194 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: WARNING keystonemiddleware.auth_token [None req-22df8dc7-4b59-4e14-aee4-7667a19396a2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 21 01:31:21.723405 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: WARNING keystonemiddleware.auth_token [None req-22df8dc7-4b59-4e14-aee4-7667a19396a2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 21 01:31:21.728862 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55557d7469c0 pid: 123542 (default app) Feb 21 01:31:59.726325 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5541c4e7-4ebf-43a2-8039-9f51d89de750 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-610074923", "imageRef": "35936a71-5ec3-4154-b01a-f2dafd8c0364", "flavorRef": "452", "networks": [{"uuid": "40c42b75-d0fb-4f29-b50c-48bc86d4bd46"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:31:59.891519 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2160f497-479a-42f2-8df3-8c6d1696f67a tempest-VolumesGetTestJSON-1296929565 tempest-VolumesGetTestJSON-1296929565-project] Action: 'create', calling method: .version_select at 0x7f4077bf00d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2039067181", "metadata": {"Type": "work"}}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:32:00.447313 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-5541c4e7-4ebf-43a2-8039-9f51d89de750 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] validate_networks() for [('40c42b75-d0fb-4f29-b50c-48bc86d4bd46', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:32:01.578565 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2160f497-479a-42f2-8df3-8c6d1696f67a tempest-VolumesGetTestJSON-1296929565 tempest-VolumesGetTestJSON-1296929565-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.764046 Feb 21 01:32:01.580839 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 1/1] 10.222.0.90 () {60 vars in 1155 bytes} [Mon Feb 21 01:31:58 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2768 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Feb 21 01:32:01.593725 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5bbcafc2-dd96-4e3e-adab-889bd7f6c090 tempest-VolumesGetTestJSON-1296929565 tempest-VolumesGetTestJSON-1296929565-project] Calling method '.version_select at 0x7f4077ab2ca0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:01.612168 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-5541c4e7-4ebf-43a2-8039-9f51d89de750 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:32:01.612774 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-5541c4e7-4ebf-43a2-8039-9f51d89de750 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:32:01.613198 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-5541c4e7-4ebf-43a2-8039-9f51d89de750 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:32:01.613615 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-5541c4e7-4ebf-43a2-8039-9f51d89de750 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:32:01.614026 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-5541c4e7-4ebf-43a2-8039-9f51d89de750 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:32:01.637635 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5541c4e7-4ebf-43a2-8039-9f51d89de750 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:01.638083 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5541c4e7-4ebf-43a2-8039-9f51d89de750 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:01.638884 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5541c4e7-4ebf-43a2-8039-9f51d89de750 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:01.639852 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5541c4e7-4ebf-43a2-8039-9f51d89de750 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:01.696686 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5bbcafc2-dd96-4e3e-adab-889bd7f6c090 tempest-VolumesGetTestJSON-1296929565 tempest-VolumesGetTestJSON-1296929565-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/5059864b-e924-49c4-8f46-59db2abb762a" status: 200 len: 353 microversion: 2.1 time: 0.107745 Feb 21 01:32:01.697328 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 2/2] 10.222.0.90 () {58 vars in 1244 bytes} [Mon Feb 21 01:32:01 2022] GET /compute/v2.1/os-volumes/5059864b-e924-49c4-8f46-59db2abb762a => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:32:01.714939 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-5541c4e7-4ebf-43a2-8039-9f51d89de750 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Getting quotas for project a2fb11bd56f946d1a12bb7aba48aece1. Resources: {'ram', 'cores', 'instances'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:32:01.722096 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-5541c4e7-4ebf-43a2-8039-9f51d89de750 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Getting quotas for user 210676a641554f6e816dda2a7717cbc4 and project a2fb11bd56f946d1a12bb7aba48aece1. Resources: {'ram', 'cores', 'instances'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:32:01.735393 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5541c4e7-4ebf-43a2-8039-9f51d89de750 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:32:01.738684 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5541c4e7-4ebf-43a2-8039-9f51d89de750 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35936a71-5ec3-4154-b01a-f2dafd8c0364',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:32:01.924173 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5541c4e7-4ebf-43a2-8039-9f51d89de750 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.692982 Feb 21 01:32:01.925137 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 1/3] 10.222.0.90 () {60 vars in 1146 bytes} [Mon Feb 21 01:31:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:32:01.941383 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a8905bca-a4b4-4878-8960-196d530eb33c tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:01.943666 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a8905bca-a4b4-4878-8960-196d530eb33c tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:02.013578 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c383ad9c-601f-4fc9-9a2f-76791394e42a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-316904283", "imageRef": "35936a71-5ec3-4154-b01a-f2dafd8c0364", "flavorRef": "452", "networks": [{"uuid": "19c3a3ee-4943-4cb3-b92f-e4a4ed0d979a"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:32:02.146824 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-a8905bca-a4b4-4878-8960-196d530eb33c tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:02.176071 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a8905bca-a4b4-4878-8960-196d530eb33c tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1214 microversion: 2.1 time: 0.244346 Feb 21 01:32:02.177139 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 2/4] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:01 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1214 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:02.192286 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-c383ad9c-601f-4fc9-9a2f-76791394e42a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] validate_networks() for [('19c3a3ee-4943-4cb3-b92f-e4a4ed0d979a', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:32:02.710498 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e268bfd3-7365-4cba-8240-e287e9c11ed5 tempest-VolumesGetTestJSON-1296929565 tempest-VolumesGetTestJSON-1296929565-project] Calling method '.version_select at 0x7f40769905e0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:02.930509 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e268bfd3-7365-4cba-8240-e287e9c11ed5 tempest-VolumesGetTestJSON-1296929565 tempest-VolumesGetTestJSON-1296929565-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/5059864b-e924-49c4-8f46-59db2abb762a" status: 200 len: 354 microversion: 2.1 time: 0.224300 Feb 21 01:32:02.931937 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 3/5] 10.222.0.90 () {58 vars in 1244 bytes} [Mon Feb 21 01:32:02 2022] GET /compute/v2.1/os-volumes/5059864b-e924-49c4-8f46-59db2abb762a => generated 354 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:32:02.937542 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-46340be6-a6ec-404f-aea3-48a410bbebd0 tempest-VolumesTestJSON-1149267608 tempest-VolumesTestJSON-1149267608-project] Calling method '.version_select at 0x7f40769a18b0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:03.026609 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-46340be6-a6ec-404f-aea3-48a410bbebd0 tempest-VolumesTestJSON-1149267608 tempest-VolumesTestJSON-1149267608-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/b8d77cbe-886c-4242-8199-f993f95d6e58" status: 200 len: 351 microversion: 2.1 time: 0.093410 Feb 21 01:32:03.027191 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 4/6] 10.222.0.90 () {58 vars in 1244 bytes} [Mon Feb 21 01:32:02 2022] GET /compute/v2.1/os-volumes/b8d77cbe-886c-4242-8199-f993f95d6e58 => generated 351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:32:03.032815 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-84b0ad0a-8bd5-4b5a-975b-0e47f7c1059f tempest-VolumesGetTestJSON-1296929565 tempest-VolumesGetTestJSON-1296929565-project] Calling method '.version_select at 0x7f40769891f0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:03.116418 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-84b0ad0a-8bd5-4b5a-975b-0e47f7c1059f tempest-VolumesGetTestJSON-1296929565 tempest-VolumesGetTestJSON-1296929565-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/5059864b-e924-49c4-8f46-59db2abb762a" status: 200 len: 354 microversion: 2.1 time: 0.086419 Feb 21 01:32:03.116418 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 5/7] 10.222.0.90 () {58 vars in 1244 bytes} [Mon Feb 21 01:32:03 2022] GET /compute/v2.1/os-volumes/5059864b-e924-49c4-8f46-59db2abb762a => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:32:03.132917 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a0606612-af72-4dd4-8a4b-d679b835842c tempest-VolumesGetTestJSON-1296929565 tempest-VolumesGetTestJSON-1296929565-project] Calling method '.version_select at 0x7f4076989af0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:03.216834 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c383ad9c-601f-4fc9-9a2f-76791394e42a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:32:03.218055 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c383ad9c-601f-4fc9-9a2f-76791394e42a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:32:03.218510 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c383ad9c-601f-4fc9-9a2f-76791394e42a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:32:03.218929 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c383ad9c-601f-4fc9-9a2f-76791394e42a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:32:03.219340 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c383ad9c-601f-4fc9-9a2f-76791394e42a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:32:03.241119 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c383ad9c-601f-4fc9-9a2f-76791394e42a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:03.241573 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c383ad9c-601f-4fc9-9a2f-76791394e42a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:03.242390 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c383ad9c-601f-4fc9-9a2f-76791394e42a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:03.242829 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c383ad9c-601f-4fc9-9a2f-76791394e42a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:03.312055 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-c383ad9c-601f-4fc9-9a2f-76791394e42a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Getting quotas for project 11d99a6bb8ad42a980e51a57fcec7315. Resources: {'ram', 'cores', 'instances'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:32:03.341672 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-c383ad9c-601f-4fc9-9a2f-76791394e42a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Getting quotas for user 35d4828335a543758d1413c0276657a6 and project 11d99a6bb8ad42a980e51a57fcec7315. Resources: {'ram', 'cores', 'instances'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:32:03.355652 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c383ad9c-601f-4fc9-9a2f-76791394e42a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:32:03.367895 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c383ad9c-601f-4fc9-9a2f-76791394e42a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35936a71-5ec3-4154-b01a-f2dafd8c0364',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:32:03.436769 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a0606612-af72-4dd4-8a4b-d679b835842c tempest-VolumesGetTestJSON-1296929565 tempest-VolumesGetTestJSON-1296929565-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/5059864b-e924-49c4-8f46-59db2abb762a" status: 202 len: 0 microversion: 2.1 time: 0.307350 Feb 21 01:32:03.437648 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 6/8] 10.222.0.90 () {58 vars in 1247 bytes} [Mon Feb 21 01:32:03 2022] DELETE /compute/v2.1/os-volumes/5059864b-e924-49c4-8f46-59db2abb762a => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 21 01:32:03.445227 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-376da46a-262a-472b-913a-d4c212c0b8e1 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:03.446490 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-376da46a-262a-472b-913a-d4c212c0b8e1 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:03.564794 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-376da46a-262a-472b-913a-d4c212c0b8e1 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:03.584736 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-376da46a-262a-472b-913a-d4c212c0b8e1 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1214 microversion: 2.1 time: 0.135792 Feb 21 01:32:03.584736 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 7/9] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:03 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1214 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:03.597993 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-196f10e6-8123-4f1f-aad4-f0d5f20d1b67 tempest-VolumesGetTestJSON-1296929565 tempest-VolumesGetTestJSON-1296929565-project] Calling method '.version_select at 0x7f4076989430>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:03.614615 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c383ad9c-601f-4fc9-9a2f-76791394e42a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.694643 Feb 21 01:32:03.615263 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 3/10] 10.222.0.90 () {60 vars in 1146 bytes} [Mon Feb 21 01:32:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 21 01:32:03.643490 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6b99f34b-2191-4f0c-9a2a-83c3b45fe275 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:03.668301 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6b99f34b-2191-4f0c-9a2a-83c3b45fe275 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:03.729818 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-196f10e6-8123-4f1f-aad4-f0d5f20d1b67 tempest-VolumesGetTestJSON-1296929565 tempest-VolumesGetTestJSON-1296929565-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/5059864b-e924-49c4-8f46-59db2abb762a" status: 200 len: 353 microversion: 2.1 time: 0.153424 Feb 21 01:32:03.730697 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 8/11] 10.222.0.90 () {58 vars in 1244 bytes} [Mon Feb 21 01:32:03 2022] GET /compute/v2.1/os-volumes/5059864b-e924-49c4-8f46-59db2abb762a => generated 353 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:32:03.803272 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-6b99f34b-2191-4f0c-9a2a-83c3b45fe275 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:03.833732 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6b99f34b-2191-4f0c-9a2a-83c3b45fe275 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1217 microversion: 2.1 time: 0.208001 Feb 21 01:32:03.846430 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 4/12] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:03 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1217 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:04.593132 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a5a56887-7254-478b-a0e0-eb68fe8abf30 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:04.593963 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a5a56887-7254-478b-a0e0-eb68fe8abf30 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:04.605755 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5a56887-7254-478b-a0e0-eb68fe8abf30 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:04.606514 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5a56887-7254-478b-a0e0-eb68fe8abf30 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:04.608196 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5a56887-7254-478b-a0e0-eb68fe8abf30 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:04.610530 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a5a56887-7254-478b-a0e0-eb68fe8abf30 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:04.742025 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e631f9b3-34af-4e98-bf34-1a63fee616f4 tempest-VolumesGetTestJSON-1296929565 tempest-VolumesGetTestJSON-1296929565-project] Calling method '.version_select at 0x7f407716be50>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:04.801793 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-e631f9b3-34af-4e98-bf34-1a63fee616f4 tempest-VolumesGetTestJSON-1296929565 tempest-VolumesGetTestJSON-1296929565-project] HTTP exception thrown: Volume 5059864b-e924-49c4-8f46-59db2abb762a could not be found. Feb 21 01:32:04.801793 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e631f9b3-34af-4e98-bf34-1a63fee616f4 tempest-VolumesGetTestJSON-1296929565 tempest-VolumesGetTestJSON-1296929565-project] Returning 404 to user: Volume 5059864b-e924-49c4-8f46-59db2abb762a could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:32:04.801793 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e631f9b3-34af-4e98-bf34-1a63fee616f4 tempest-VolumesGetTestJSON-1296929565 tempest-VolumesGetTestJSON-1296929565-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/5059864b-e924-49c4-8f46-59db2abb762a" status: 404 len: 109 microversion: 2.1 time: 0.062732 Feb 21 01:32:04.808569 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 5/13] 10.222.0.90 () {58 vars in 1244 bytes} [Mon Feb 21 01:32:04 2022] GET /compute/v2.1/os-volumes/5059864b-e924-49c4-8f46-59db2abb762a => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:32:04.852067 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f0ea0429-55b6-473a-9ba8-8746d914eaa7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:04.852762 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f0ea0429-55b6-473a-9ba8-8746d914eaa7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:05.198806 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-a5a56887-7254-478b-a0e0-eb68fe8abf30 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:05.203017 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-f0ea0429-55b6-473a-9ba8-8746d914eaa7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:05.212202 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f0ea0429-55b6-473a-9ba8-8746d914eaa7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1217 microversion: 2.1 time: 0.364089 Feb 21 01:32:05.216232 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 6/14] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:04 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1217 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:05.225698 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a5a56887-7254-478b-a0e0-eb68fe8abf30 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1218 microversion: 2.1 time: 0.635489 Feb 21 01:32:05.228206 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 9/15] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:04 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1218 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:05.979601 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e215f1a1-a860-4f7c-b6aa-f33e52f7b70c tempest-VolumesTestJSON-1149267608 tempest-VolumesTestJSON-1149267608-project] Calling method '.version_select at 0x7f407690f0d0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:06.097214 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e215f1a1-a860-4f7c-b6aa-f33e52f7b70c tempest-VolumesTestJSON-1149267608 tempest-VolumesTestJSON-1149267608-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/a46e763e-8ccb-4c91-acb4-ab247e3c5973" status: 200 len: 350 microversion: 2.1 time: 0.121158 Feb 21 01:32:06.105551 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 7/16] 10.222.0.90 () {58 vars in 1244 bytes} [Mon Feb 21 01:32:05 2022] GET /compute/v2.1/os-volumes/a46e763e-8ccb-4c91-acb4-ab247e3c5973 => generated 350 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:32:06.229829 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c5f93b58-7022-4df4-a60b-9e1787a277d7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:06.230455 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c5f93b58-7022-4df4-a60b-9e1787a277d7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:06.243309 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f1895e7a-231c-482e-9c51-3a3c61a76962 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:06.244200 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f1895e7a-231c-482e-9c51-3a3c61a76962 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:06.250207 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5f93b58-7022-4df4-a60b-9e1787a277d7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:06.256039 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1895e7a-231c-482e-9c51-3a3c61a76962 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:06.258142 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1895e7a-231c-482e-9c51-3a3c61a76962 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:06.261484 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1895e7a-231c-482e-9c51-3a3c61a76962 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:06.262387 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5f93b58-7022-4df4-a60b-9e1787a277d7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:06.263379 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5f93b58-7022-4df4-a60b-9e1787a277d7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:06.264021 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f1895e7a-231c-482e-9c51-3a3c61a76962 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:06.273131 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5f93b58-7022-4df4-a60b-9e1787a277d7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:06.461855 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-f1895e7a-231c-482e-9c51-3a3c61a76962 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:06.462640 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-c5f93b58-7022-4df4-a60b-9e1787a277d7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:06.471456 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c5f93b58-7022-4df4-a60b-9e1787a277d7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1221 microversion: 2.1 time: 0.246067 Feb 21 01:32:06.485588 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 10/17] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:06 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1221 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:06.492466 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f1895e7a-231c-482e-9c51-3a3c61a76962 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1266 microversion: 2.1 time: 0.253206 Feb 21 01:32:06.498298 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 8/18] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:06 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:07.493505 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9a341128-691c-4786-a84b-228afe1a8613 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:07.494805 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9a341128-691c-4786-a84b-228afe1a8613 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:07.505184 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a341128-691c-4786-a84b-228afe1a8613 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:07.512107 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a341128-691c-4786-a84b-228afe1a8613 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:07.515026 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0858d655-7add-46b0-ad81-71b643de041e tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:07.515647 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0858d655-7add-46b0-ad81-71b643de041e tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:07.516466 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a341128-691c-4786-a84b-228afe1a8613 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:07.516962 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9a341128-691c-4786-a84b-228afe1a8613 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:07.525482 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0858d655-7add-46b0-ad81-71b643de041e tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:07.525940 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0858d655-7add-46b0-ad81-71b643de041e tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:07.526895 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0858d655-7add-46b0-ad81-71b643de041e tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:07.527478 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0858d655-7add-46b0-ad81-71b643de041e tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:07.639992 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-0858d655-7add-46b0-ad81-71b643de041e tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:07.647681 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0858d655-7add-46b0-ad81-71b643de041e tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1266 microversion: 2.1 time: 0.136342 Feb 21 01:32:07.671004 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 9/19] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:07 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:07.671086 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-9a341128-691c-4786-a84b-228afe1a8613 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:07.674388 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9a341128-691c-4786-a84b-228afe1a8613 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1221 microversion: 2.1 time: 0.180002 Feb 21 01:32:07.675385 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 11/20] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:07 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1221 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:08.734149 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e099a859-4f9c-48f8-bce8-fd1c640508f2 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:08.734149 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e099a859-4f9c-48f8-bce8-fd1c640508f2 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:08.734149 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e099a859-4f9c-48f8-bce8-fd1c640508f2 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:08.734149 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e099a859-4f9c-48f8-bce8-fd1c640508f2 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:08.736568 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e099a859-4f9c-48f8-bce8-fd1c640508f2 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:08.736568 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e099a859-4f9c-48f8-bce8-fd1c640508f2 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:08.736721 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6feae56a-fcbc-46c1-807f-1f24b48a2e5e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:08.736721 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6feae56a-fcbc-46c1-807f-1f24b48a2e5e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:08.736721 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6feae56a-fcbc-46c1-807f-1f24b48a2e5e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:08.736721 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6feae56a-fcbc-46c1-807f-1f24b48a2e5e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:08.737252 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6feae56a-fcbc-46c1-807f-1f24b48a2e5e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:08.737252 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6feae56a-fcbc-46c1-807f-1f24b48a2e5e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:08.837855 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-e099a859-4f9c-48f8-bce8-fd1c640508f2 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:08.860628 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e099a859-4f9c-48f8-bce8-fd1c640508f2 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1266 microversion: 2.1 time: 0.195276 Feb 21 01:32:08.862969 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 10/21] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:08 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:08.921561 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-6feae56a-fcbc-46c1-807f-1f24b48a2e5e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:08.932649 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6feae56a-fcbc-46c1-807f-1f24b48a2e5e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1221 microversion: 2.1 time: 0.244616 Feb 21 01:32:08.935047 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 12/22] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:08 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1221 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:09.879090 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3886cfcc-137e-4c46-a9be-77ab00136602 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:09.880753 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3886cfcc-137e-4c46-a9be-77ab00136602 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:09.894469 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3886cfcc-137e-4c46-a9be-77ab00136602 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:09.894469 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3886cfcc-137e-4c46-a9be-77ab00136602 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:09.894469 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3886cfcc-137e-4c46-a9be-77ab00136602 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:09.894469 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3886cfcc-137e-4c46-a9be-77ab00136602 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:09.952812 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2b507c57-b2ac-48b9-963b-feed5cd0dcd0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:09.954023 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2b507c57-b2ac-48b9-963b-feed5cd0dcd0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:09.963904 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b507c57-b2ac-48b9-963b-feed5cd0dcd0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:09.968745 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b507c57-b2ac-48b9-963b-feed5cd0dcd0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:09.973744 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b507c57-b2ac-48b9-963b-feed5cd0dcd0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:09.975091 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2b507c57-b2ac-48b9-963b-feed5cd0dcd0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:10.122252 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-3886cfcc-137e-4c46-a9be-77ab00136602 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:10.140039 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3886cfcc-137e-4c46-a9be-77ab00136602 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1266 microversion: 2.1 time: 0.265287 Feb 21 01:32:10.148572 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 11/23] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:09 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1266 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:10.185296 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2b507c57-b2ac-48b9-963b-feed5cd0dcd0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:10.193292 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2b507c57-b2ac-48b9-963b-feed5cd0dcd0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1221 microversion: 2.1 time: 0.245438 Feb 21 01:32:10.193853 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 13/24] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:09 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1221 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:11.166035 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-caa358ef-a156-45ae-9d8a-a8cb2ee24096 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:11.167345 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-caa358ef-a156-45ae-9d8a-a8cb2ee24096 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:11.181538 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-caa358ef-a156-45ae-9d8a-a8cb2ee24096 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:11.182198 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-caa358ef-a156-45ae-9d8a-a8cb2ee24096 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:11.184575 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-caa358ef-a156-45ae-9d8a-a8cb2ee24096 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:11.192338 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-caa358ef-a156-45ae-9d8a-a8cb2ee24096 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:11.210932 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-989a8930-2350-4da9-8629-26e672658ace tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:11.211542 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-989a8930-2350-4da9-8629-26e672658ace tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:11.223469 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-989a8930-2350-4da9-8629-26e672658ace tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:11.227316 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-989a8930-2350-4da9-8629-26e672658ace tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:11.228373 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-989a8930-2350-4da9-8629-26e672658ace tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:11.230460 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-989a8930-2350-4da9-8629-26e672658ace tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:11.406910 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-caa358ef-a156-45ae-9d8a-a8cb2ee24096 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:11.414131 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-989a8930-2350-4da9-8629-26e672658ace tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:11.422556 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-989a8930-2350-4da9-8629-26e672658ace tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1269 microversion: 2.1 time: 0.215353 Feb 21 01:32:11.423147 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 14/25] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:11 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1269 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:11.428839 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-caa358ef-a156-45ae-9d8a-a8cb2ee24096 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1274 microversion: 2.1 time: 0.266283 Feb 21 01:32:11.432241 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 12/26] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:11 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1274 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:12.403497 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-df042a22-7bd6-41dd-a3d3-37ce2826350c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Action: 'create', calling method: .version_select at 0x7f407690a940>, body: {"keypair": {"name": "tempest-keypair-273732818"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:32:12.440092 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-93d2065f-84a5-4fd1-84e4-699bf75414d3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:12.442117 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-93d2065f-84a5-4fd1-84e4-699bf75414d3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:12.448121 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-df042a22-7bd6-41dd-a3d3-37ce2826350c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Getting quotas for project d3acaa73503748ac9764a7eca8943882. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:32:12.464655 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93d2065f-84a5-4fd1-84e4-699bf75414d3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:12.465119 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93d2065f-84a5-4fd1-84e4-699bf75414d3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:12.465928 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93d2065f-84a5-4fd1-84e4-699bf75414d3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:12.474271 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-df042a22-7bd6-41dd-a3d3-37ce2826350c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Getting quotas for user ab38a084fbb643298d38c4cd8dcf87cd and project d3acaa73503748ac9764a7eca8943882. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:32:12.478649 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93d2065f-84a5-4fd1-84e4-699bf75414d3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:12.861430 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-df042a22-7bd6-41dd-a3d3-37ce2826350c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Getting quotas for project d3acaa73503748ac9764a7eca8943882. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:32:12.879808 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-93d2065f-84a5-4fd1-84e4-699bf75414d3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:12.881627 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-df042a22-7bd6-41dd-a3d3-37ce2826350c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Getting quotas for user ab38a084fbb643298d38c4cd8dcf87cd and project d3acaa73503748ac9764a7eca8943882. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:32:12.888110 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-93d2065f-84a5-4fd1-84e4-699bf75414d3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1287 microversion: 2.1 time: 0.451564 Feb 21 01:32:12.900902 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 13/27] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:12 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1287 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:12.909917 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9bb3bb32-56f4-4141-9233-3c0abdd4ae59 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:12.910542 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9bb3bb32-56f4-4141-9233-3c0abdd4ae59 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:12.941015 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bb3bb32-56f4-4141-9233-3c0abdd4ae59 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:12.941497 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bb3bb32-56f4-4141-9233-3c0abdd4ae59 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:12.942329 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bb3bb32-56f4-4141-9233-3c0abdd4ae59 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:12.942773 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9bb3bb32-56f4-4141-9233-3c0abdd4ae59 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:12.944132 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-df042a22-7bd6-41dd-a3d3-37ce2826350c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.852901 Feb 21 01:32:12.948296 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 15/28] 10.222.0.90 () {62 vars in 1198 bytes} [Mon Feb 21 01:32:12 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 858 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Feb 21 01:32:13.090519 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-9bb3bb32-56f4-4141-9233-3c0abdd4ae59 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:13.095647 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6d0a6ae2-e92c-4ae0-a83c-cd549faa24ea tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1598439144", "imageRef": "35936a71-5ec3-4154-b01a-f2dafd8c0364", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:32:13.099784 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9bb3bb32-56f4-4141-9233-3c0abdd4ae59 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1272 microversion: 2.1 time: 0.193082 Feb 21 01:32:13.100151 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 14/29] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:12 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1272 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:13.117844 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fb3e196c-fe8f-497c-9f2b-b0ef365a0989 tempest-VolumesTestJSON-1149267608 tempest-VolumesTestJSON-1149267608-project] Calling method '.version_select at 0x7f407685eaf0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:13.258004 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-6d0a6ae2-e92c-4ae0-a83c-cd549faa24ea tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] validate_networks() for [('f0ce3d49-217f-425e-8faa-7de06bd3cd36', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:32:13.266531 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fb3e196c-fe8f-497c-9f2b-b0ef365a0989 tempest-VolumesTestJSON-1149267608 tempest-VolumesTestJSON-1149267608-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/5f5a3be8-1e49-4f8c-9df3-c98cc4c47b7f" status: 200 len: 349 microversion: 2.1 time: 0.152806 Feb 21 01:32:13.273510 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 15/30] 10.222.0.90 () {58 vars in 1244 bytes} [Mon Feb 21 01:32:13 2022] GET /compute/v2.1/os-volumes/5f5a3be8-1e49-4f8c-9df3-c98cc4c47b7f => generated 349 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:32:13.283652 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dd2dd604-db7b-4596-896d-d9da74dc6b31 tempest-VolumesTestJSON-1149267608 tempest-VolumesTestJSON-1149267608-project] Calling method '.version_select at 0x7f407690f310>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:13.497300 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dd2dd604-db7b-4596-896d-d9da74dc6b31 tempest-VolumesTestJSON-1149267608 tempest-VolumesTestJSON-1149267608-project] 10.222.0.90 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.222083 Feb 21 01:32:13.497981 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 16/31] 10.222.0.90 () {58 vars in 1133 bytes} [Mon Feb 21 01:32:13 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:13.745119 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-77f5a4e9-9add-444f-a9d9-cd606402514a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Action: 'create', calling method: .version_select at 0x7f4076854940>, body: {"keypair": {"name": "tempest-keypair-287381293"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:32:13.818175 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-77f5a4e9-9add-444f-a9d9-cd606402514a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Getting quotas for project 09bc5c58fd414c8aa76756065678191e. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:32:13.833239 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-77f5a4e9-9add-444f-a9d9-cd606402514a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Getting quotas for user 4d834a0b1ec1481eaf1387dd4e302cd3 and project 09bc5c58fd414c8aa76756065678191e. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:32:14.410338 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-77f5a4e9-9add-444f-a9d9-cd606402514a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Getting quotas for project 09bc5c58fd414c8aa76756065678191e. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:32:14.415026 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-77f5a4e9-9add-444f-a9d9-cd606402514a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Getting quotas for user 4d834a0b1ec1481eaf1387dd4e302cd3 and project 09bc5c58fd414c8aa76756065678191e. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:32:14.443023 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-77f5a4e9-9add-444f-a9d9-cd606402514a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.944047 Feb 21 01:32:14.444907 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 17/32] 10.222.0.90 () {60 vars in 1157 bytes} [Mon Feb 21 01:32:13 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:14.462015 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e81e3e10-7bb4-49fc-900b-df484add95e6 tempest-VolumesTestJSON-1149267608 tempest-VolumesTestJSON-1149267608-project] Calling method '.version_select at 0x7f4076854670>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:14.606423 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e81e3e10-7bb4-49fc-900b-df484add95e6 tempest-VolumesTestJSON-1149267608 tempest-VolumesTestJSON-1149267608-project] 10.222.0.90 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.152269 Feb 21 01:32:14.606423 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 18/33] 10.222.0.90 () {58 vars in 1148 bytes} [Mon Feb 21 01:32:14 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:32:14.606423 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-675751e4-5125-4500-8009-63c5bed2da0f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:14.606423 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-675751e4-5125-4500-8009-63c5bed2da0f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:14.620138 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-675751e4-5125-4500-8009-63c5bed2da0f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:14.620629 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-675751e4-5125-4500-8009-63c5bed2da0f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:14.621429 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-675751e4-5125-4500-8009-63c5bed2da0f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:14.621866 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-675751e4-5125-4500-8009-63c5bed2da0f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:14.776246 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-675751e4-5125-4500-8009-63c5bed2da0f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:14.785844 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-675751e4-5125-4500-8009-63c5bed2da0f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1275 microversion: 2.1 time: 0.185815 Feb 21 01:32:14.786435 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 19/34] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:14 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1275 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:14.795566 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-190e3629-eca7-46f7-929c-ec186f58f3e5 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:14.802337 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-190e3629-eca7-46f7-929c-ec186f58f3e5 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:14.818784 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-190e3629-eca7-46f7-929c-ec186f58f3e5 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:14.819491 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-190e3629-eca7-46f7-929c-ec186f58f3e5 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:14.820482 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-190e3629-eca7-46f7-929c-ec186f58f3e5 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:14.821065 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-190e3629-eca7-46f7-929c-ec186f58f3e5 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:15.708529 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-190e3629-eca7-46f7-929c-ec186f58f3e5 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:15.722175 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-190e3629-eca7-46f7-929c-ec186f58f3e5 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.932438 Feb 21 01:32:15.722941 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 20/35] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:14 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:15.727571 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8e2a3bf3-50da-47cc-8a95-3c67c900031a tempest-VolumesTestJSON-1149267608 tempest-VolumesTestJSON-1149267608-project] Calling method '.version_select at 0x7f4076873b80>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:15.772692 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-6d0a6ae2-e92c-4ae0-a83c-cd549faa24ea tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:32:15.773682 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-6d0a6ae2-e92c-4ae0-a83c-cd549faa24ea tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:32:15.774313 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-6d0a6ae2-e92c-4ae0-a83c-cd549faa24ea tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:32:15.775037 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-6d0a6ae2-e92c-4ae0-a83c-cd549faa24ea tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:32:15.775611 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-6d0a6ae2-e92c-4ae0-a83c-cd549faa24ea tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:32:15.786253 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d0a6ae2-e92c-4ae0-a83c-cd549faa24ea tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:15.786898 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d0a6ae2-e92c-4ae0-a83c-cd549faa24ea tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:15.787880 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d0a6ae2-e92c-4ae0-a83c-cd549faa24ea tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:15.788562 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d0a6ae2-e92c-4ae0-a83c-cd549faa24ea tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:15.858634 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-6d0a6ae2-e92c-4ae0-a83c-cd549faa24ea tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Getting quotas for project fa11c817930e42c49bb0f242205952d7. Resources: {'ram', 'cores', 'instances'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:32:15.862916 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-6d0a6ae2-e92c-4ae0-a83c-cd549faa24ea tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Getting quotas for user f213f03b8c094202b25d6a1fcccb5994 and project fa11c817930e42c49bb0f242205952d7. Resources: {'ram', 'cores', 'instances'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:32:15.876671 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6d0a6ae2-e92c-4ae0-a83c-cd549faa24ea tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:32:15.879133 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6d0a6ae2-e92c-4ae0-a83c-cd549faa24ea tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35936a71-5ec3-4154-b01a-f2dafd8c0364',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:32:15.967444 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8e2a3bf3-50da-47cc-8a95-3c67c900031a tempest-VolumesTestJSON-1149267608 tempest-VolumesTestJSON-1149267608-project] 10.222.0.90 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.243232 Feb 21 01:32:15.969652 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 21/36] 10.222.0.90 () {58 vars in 1133 bytes} [Mon Feb 21 01:32:15 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:15.981787 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5d07aa34-2851-4228-b01d-5ed7ff4a6d02 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:15.983151 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5d07aa34-2851-4228-b01d-5ed7ff4a6d02 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:15.992837 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d07aa34-2851-4228-b01d-5ed7ff4a6d02 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:15.993953 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d07aa34-2851-4228-b01d-5ed7ff4a6d02 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:15.995799 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d07aa34-2851-4228-b01d-5ed7ff4a6d02 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:15.996496 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d07aa34-2851-4228-b01d-5ed7ff4a6d02 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:16.168377 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6d0a6ae2-e92c-4ae0-a83c-cd549faa24ea tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.201284 Feb 21 01:32:16.169173 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 16/37] 10.222.0.90 () {60 vars in 1146 bytes} [Mon Feb 21 01:32:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 3219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:32:16.183175 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d24fe681-78a5-40ac-bcbf-3c10f44a5748 tempest-VolumesTestJSON-1149267608 tempest-VolumesTestJSON-1149267608-project] Calling method '.version_select at 0x7f407690a9d0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:16.326117 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-5d07aa34-2851-4228-b01d-5ed7ff4a6d02 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:16.424414 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5d07aa34-2851-4228-b01d-5ed7ff4a6d02 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.369900 Feb 21 01:32:16.424414 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 22/38] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:15 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:16.424414 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b3d03707-721c-47e6-823e-0cc7ab45d1ae tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:16.424414 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b3d03707-721c-47e6-823e-0cc7ab45d1ae tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:16.425306 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d24fe681-78a5-40ac-bcbf-3c10f44a5748 tempest-VolumesTestJSON-1149267608 tempest-VolumesTestJSON-1149267608-project] 10.222.0.90 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.181468 Feb 21 01:32:16.425306 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 17/39] 10.222.0.90 () {58 vars in 1166 bytes} [Mon Feb 21 01:32:16 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:32:16.426467 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-468c307c-80d8-4366-ba44-8f11db509896 tempest-VolumesTestJSON-1149267608 tempest-VolumesTestJSON-1149267608-project] Calling method '.version_select at 0x7f407690aee0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:16.467736 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-b3d03707-721c-47e6-823e-0cc7ab45d1ae tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:16.475633 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b3d03707-721c-47e6-823e-0cc7ab45d1ae tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1222 microversion: 2.1 time: 0.130112 Feb 21 01:32:16.477837 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 23/40] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:16 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1222 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:16.571410 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-468c307c-80d8-4366-ba44-8f11db509896 tempest-VolumesTestJSON-1149267608 tempest-VolumesTestJSON-1149267608-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.149269 Feb 21 01:32:16.572460 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 18/41] 10.222.0.90 () {58 vars in 1169 bytes} [Mon Feb 21 01:32:16 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:32:16.590644 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-93bcd13f-812d-46f1-9ee1-a013b665d8b0 tempest-VolumesTestJSON-1149267608 tempest-VolumesTestJSON-1149267608-project] Calling method '.version_select at 0x7f4076858310>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:16.595145 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-90e7c656-8320-484b-a68b-7200b2bf3e80 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1625937110", "imageRef": "35936a71-5ec3-4154-b01a-f2dafd8c0364", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:32:16.694912 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-90e7c656-8320-484b-a68b-7200b2bf3e80 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] validate_networks() for [('f0ce3d49-217f-425e-8faa-7de06bd3cd36', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:32:16.767869 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-93bcd13f-812d-46f1-9ee1-a013b665d8b0 tempest-VolumesTestJSON-1149267608 tempest-VolumesTestJSON-1149267608-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.185965 Feb 21 01:32:16.768532 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 19/42] 10.222.0.90 () {58 vars in 1154 bytes} [Mon Feb 21 01:32:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:16.773308 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4cba9b8c-ea41-447a-a385-26ae4829a0ae tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:16.774909 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4cba9b8c-ea41-447a-a385-26ae4829a0ae tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:16.788022 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4cba9b8c-ea41-447a-a385-26ae4829a0ae tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:16.792770 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4cba9b8c-ea41-447a-a385-26ae4829a0ae tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:16.792770 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4cba9b8c-ea41-447a-a385-26ae4829a0ae tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:16.793675 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4cba9b8c-ea41-447a-a385-26ae4829a0ae tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:17.357724 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-4cba9b8c-ea41-447a-a385-26ae4829a0ae tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:17.413752 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4cba9b8c-ea41-447a-a385-26ae4829a0ae tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.638469 Feb 21 01:32:17.431116 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 20/43] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:16 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:17.454167 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e0f9cabc-711f-4ddb-b28b-0f2f58c93e28 tempest-VolumesTestJSON-1149267608 tempest-VolumesTestJSON-1149267608-project] Calling method '.version_select at 0x7f4076858430>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:17.635710 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-90e7c656-8320-484b-a68b-7200b2bf3e80 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:32:17.636742 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-90e7c656-8320-484b-a68b-7200b2bf3e80 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:32:17.637380 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-90e7c656-8320-484b-a68b-7200b2bf3e80 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:32:17.637933 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-90e7c656-8320-484b-a68b-7200b2bf3e80 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:32:17.638566 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-90e7c656-8320-484b-a68b-7200b2bf3e80 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:32:17.648855 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-90e7c656-8320-484b-a68b-7200b2bf3e80 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:17.649796 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-90e7c656-8320-484b-a68b-7200b2bf3e80 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:17.650773 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-90e7c656-8320-484b-a68b-7200b2bf3e80 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:17.651376 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-90e7c656-8320-484b-a68b-7200b2bf3e80 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:17.789998 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-90e7c656-8320-484b-a68b-7200b2bf3e80 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Getting quotas for project fa11c817930e42c49bb0f242205952d7. Resources: {'ram', 'cores', 'instances'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:32:17.789998 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-90e7c656-8320-484b-a68b-7200b2bf3e80 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Getting quotas for user f213f03b8c094202b25d6a1fcccb5994 and project fa11c817930e42c49bb0f242205952d7. Resources: {'ram', 'cores', 'instances'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:32:17.789998 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-90e7c656-8320-484b-a68b-7200b2bf3e80 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:32:17.794212 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-90e7c656-8320-484b-a68b-7200b2bf3e80 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35936a71-5ec3-4154-b01a-f2dafd8c0364',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:32:17.795307 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e0f9cabc-711f-4ddb-b28b-0f2f58c93e28 tempest-VolumesTestJSON-1149267608 tempest-VolumesTestJSON-1149267608-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.357390 Feb 21 01:32:17.797186 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 21/44] 10.222.0.90 () {58 vars in 1187 bytes} [Mon Feb 21 01:32:17 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:32:17.809582 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3b293d2c-e5af-4abe-81c6-2e5282234133 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:17.810186 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3b293d2c-e5af-4abe-81c6-2e5282234133 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:17.818246 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b293d2c-e5af-4abe-81c6-2e5282234133 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:17.818942 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b293d2c-e5af-4abe-81c6-2e5282234133 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:17.820149 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b293d2c-e5af-4abe-81c6-2e5282234133 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:17.827264 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3b293d2c-e5af-4abe-81c6-2e5282234133 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:17.969797 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-90e7c656-8320-484b-a68b-7200b2bf3e80 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.388661 Feb 21 01:32:17.973228 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 24/45] 10.222.0.90 () {60 vars in 1146 bytes} [Mon Feb 21 01:32:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 1391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:32:17.981438 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-86f84f0b-a001-42d5-9950-282d0c3ea1cb tempest-VolumesTestJSON-1149267608 tempest-VolumesTestJSON-1149267608-project] Calling method '.version_select at 0x7f40768bbca0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:18.080532 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-86f84f0b-a001-42d5-9950-282d0c3ea1cb tempest-VolumesTestJSON-1149267608 tempest-VolumesTestJSON-1149267608-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.105918 Feb 21 01:32:18.093210 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 25/46] 10.222.0.90 () {58 vars in 1154 bytes} [Mon Feb 21 01:32:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:18.098328 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-3b293d2c-e5af-4abe-81c6-2e5282234133 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:18.107550 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-09899999-8571-4aa8-8faa-4e0dc7db81e4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:18.111169 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-09899999-8571-4aa8-8faa-4e0dc7db81e4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:18.116758 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3b293d2c-e5af-4abe-81c6-2e5282234133 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.308267 Feb 21 01:32:18.119046 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 22/47] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:17 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:18.200204 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-09899999-8571-4aa8-8faa-4e0dc7db81e4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:18.212952 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-09899999-8571-4aa8-8faa-4e0dc7db81e4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1222 microversion: 2.1 time: 0.113688 Feb 21 01:32:18.212952 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 26/48] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:18 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1222 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:18.449002 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7310461c-7c00-46c1-a4c5-b9ae9cd27c07 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:18.454959 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7310461c-7c00-46c1-a4c5-b9ae9cd27c07 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:18.487355 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7310461c-7c00-46c1-a4c5-b9ae9cd27c07 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:18.496683 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7310461c-7c00-46c1-a4c5-b9ae9cd27c07 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:18.498308 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7310461c-7c00-46c1-a4c5-b9ae9cd27c07 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:18.498886 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7310461c-7c00-46c1-a4c5-b9ae9cd27c07 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:18.745466 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-7310461c-7c00-46c1-a4c5-b9ae9cd27c07 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:18.762177 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7310461c-7c00-46c1-a4c5-b9ae9cd27c07 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.330267 Feb 21 01:32:18.768092 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 23/49] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:18 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:19.139778 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cb79840e-2508-4502-b21c-66ccf85d4f98 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:19.142022 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cb79840e-2508-4502-b21c-66ccf85d4f98 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:19.166481 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb79840e-2508-4502-b21c-66ccf85d4f98 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:19.166481 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb79840e-2508-4502-b21c-66ccf85d4f98 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:19.169545 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb79840e-2508-4502-b21c-66ccf85d4f98 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:19.170290 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb79840e-2508-4502-b21c-66ccf85d4f98 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:19.227616 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fcaa1f2c-7157-48c4-8767-d4dd2483b994 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:19.228516 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fcaa1f2c-7157-48c4-8767-d4dd2483b994 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:19.250410 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fcaa1f2c-7157-48c4-8767-d4dd2483b994 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:19.252125 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fcaa1f2c-7157-48c4-8767-d4dd2483b994 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:19.254757 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fcaa1f2c-7157-48c4-8767-d4dd2483b994 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:19.258355 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fcaa1f2c-7157-48c4-8767-d4dd2483b994 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:19.511035 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-fcaa1f2c-7157-48c4-8767-d4dd2483b994 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:19.519196 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fcaa1f2c-7157-48c4-8767-d4dd2483b994 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1226 microversion: 2.1 time: 0.296891 Feb 21 01:32:19.529140 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 24/50] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:19 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1226 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:19.731600 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-646c5ea8-c2fe-4db5-aa8b-8bee77313c10 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-976933993", "imageRef": "35936a71-5ec3-4154-b01a-f2dafd8c0364", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ed6465a-9bc3-4ebd-8f4a-72b7db58dd61"}], "security_groups": [{"name": "tempest-securitygroup--1717250912"}], "key_name": "tempest-keypair-273732818", "user_data": "}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:32:20.615198 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-cb79840e-2508-4502-b21c-66ccf85d4f98 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:20.625564 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cb79840e-2508-4502-b21c-66ccf85d4f98 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 1.495928 Feb 21 01:32:20.633296 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 27/51] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:19 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:20.641094 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cb20606c-0ffd-4842-8fe4-9c7ebe8279ce tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:20.646306 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cb20606c-0ffd-4842-8fe4-9c7ebe8279ce tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:20.664077 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb20606c-0ffd-4842-8fe4-9c7ebe8279ce tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:20.664979 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb20606c-0ffd-4842-8fe4-9c7ebe8279ce tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:20.666184 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb20606c-0ffd-4842-8fe4-9c7ebe8279ce tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:20.666840 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb20606c-0ffd-4842-8fe4-9c7ebe8279ce tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:20.676098 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-646c5ea8-c2fe-4db5-aa8b-8bee77313c10 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] validate_networks() for [('6ed6465a-9bc3-4ebd-8f4a-72b7db58dd61', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:32:21.697675 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-cb20606c-0ffd-4842-8fe4-9c7ebe8279ce tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:21.710625 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cb20606c-0ffd-4842-8fe4-9c7ebe8279ce tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 1.075751 Feb 21 01:32:21.712139 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 28/52] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:20 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:21.718858 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-251c8a4c-e3da-4ddf-906a-5dc248451813 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-711318348", "imageRef": "35936a71-5ec3-4154-b01a-f2dafd8c0364", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "27d681c4-c216-4785-93dd-e8601d1c0576"}], "security_groups": [{"name": "tempest-securitygroup--2001029642"}], "key_name": "tempest-keypair-287381293", "user_data": "}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:32:21.964505 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-251c8a4c-e3da-4ddf-906a-5dc248451813 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] validate_networks() for [('27d681c4-c216-4785-93dd-e8601d1c0576', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:32:22.421397 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-646c5ea8-c2fe-4db5-aa8b-8bee77313c10 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:32:22.422225 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-646c5ea8-c2fe-4db5-aa8b-8bee77313c10 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:32:22.422321 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-646c5ea8-c2fe-4db5-aa8b-8bee77313c10 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:32:22.422716 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-646c5ea8-c2fe-4db5-aa8b-8bee77313c10 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:32:22.423103 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-646c5ea8-c2fe-4db5-aa8b-8bee77313c10 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:32:22.438356 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-646c5ea8-c2fe-4db5-aa8b-8bee77313c10 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:22.447214 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-646c5ea8-c2fe-4db5-aa8b-8bee77313c10 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:22.448966 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-646c5ea8-c2fe-4db5-aa8b-8bee77313c10 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:22.449633 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-646c5ea8-c2fe-4db5-aa8b-8bee77313c10 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:22.476898 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-646c5ea8-c2fe-4db5-aa8b-8bee77313c10 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Getting quotas for project d3acaa73503748ac9764a7eca8943882. Resources: {'ram', 'cores', 'instances'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:32:22.481104 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-646c5ea8-c2fe-4db5-aa8b-8bee77313c10 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Getting quotas for user ab38a084fbb643298d38c4cd8dcf87cd and project d3acaa73503748ac9764a7eca8943882. Resources: {'ram', 'cores', 'instances'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:32:22.493553 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-646c5ea8-c2fe-4db5-aa8b-8bee77313c10 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:32:22.496168 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-646c5ea8-c2fe-4db5-aa8b-8bee77313c10 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35936a71-5ec3-4154-b01a-f2dafd8c0364',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:32:22.746812 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-251c8a4c-e3da-4ddf-906a-5dc248451813 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:32:22.748922 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-251c8a4c-e3da-4ddf-906a-5dc248451813 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:32:22.758356 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-251c8a4c-e3da-4ddf-906a-5dc248451813 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:32:22.758356 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-251c8a4c-e3da-4ddf-906a-5dc248451813 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:32:22.758356 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-251c8a4c-e3da-4ddf-906a-5dc248451813 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:32:22.764449 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-251c8a4c-e3da-4ddf-906a-5dc248451813 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:22.764923 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-251c8a4c-e3da-4ddf-906a-5dc248451813 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:22.767828 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-251c8a4c-e3da-4ddf-906a-5dc248451813 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:22.769002 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-251c8a4c-e3da-4ddf-906a-5dc248451813 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:22.787696 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-251c8a4c-e3da-4ddf-906a-5dc248451813 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Getting quotas for project 09bc5c58fd414c8aa76756065678191e. Resources: {'ram', 'cores', 'instances'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:32:22.792514 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-251c8a4c-e3da-4ddf-906a-5dc248451813 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Getting quotas for user 4d834a0b1ec1481eaf1387dd4e302cd3 and project 09bc5c58fd414c8aa76756065678191e. Resources: {'ram', 'cores', 'instances'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:32:22.807451 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-251c8a4c-e3da-4ddf-906a-5dc248451813 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:32:22.809754 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-251c8a4c-e3da-4ddf-906a-5dc248451813 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35936a71-5ec3-4154-b01a-f2dafd8c0364',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:32:22.932829 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-646c5ea8-c2fe-4db5-aa8b-8bee77313c10 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.205133 Feb 21 01:32:22.939185 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 25/53] 10.222.0.90 () {62 vars in 1187 bytes} [Mon Feb 21 01:32:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 3208 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Feb 21 01:32:22.940710 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1efa99e6-3ab4-4f94-87f8-bb20ce485d45 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:22.941401 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1efa99e6-3ab4-4f94-87f8-bb20ce485d45 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:22.947969 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1efa99e6-3ab4-4f94-87f8-bb20ce485d45 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:22.948533 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1efa99e6-3ab4-4f94-87f8-bb20ce485d45 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:22.949436 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1efa99e6-3ab4-4f94-87f8-bb20ce485d45 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:22.949995 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1efa99e6-3ab4-4f94-87f8-bb20ce485d45 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:23.019434 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1efa99e6-3ab4-4f94-87f8-bb20ce485d45 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:23.031003 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1efa99e6-3ab4-4f94-87f8-bb20ce485d45 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1282 microversion: 2.1 time: 0.095563 Feb 21 01:32:23.032061 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 26/54] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:22 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1282 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:23.048997 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3ae53568-22bf-40d5-8e07-b78fa8bca209 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:23.049720 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3ae53568-22bf-40d5-8e07-b78fa8bca209 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:23.054782 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-251c8a4c-e3da-4ddf-906a-5dc248451813 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.341326 Feb 21 01:32:23.056271 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 29/55] 10.222.0.90 () {60 vars in 1146 bytes} [Mon Feb 21 01:32:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1343 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:32:23.063453 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ae53568-22bf-40d5-8e07-b78fa8bca209 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:23.064031 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ae53568-22bf-40d5-8e07-b78fa8bca209 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:23.064978 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ae53568-22bf-40d5-8e07-b78fa8bca209 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:23.067256 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ae53568-22bf-40d5-8e07-b78fa8bca209 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:23.154774 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-4b9181c5-8717-47ad-82be-8b3f7ec44379 req-8407fe32-b222-4f3a-a494-1cbcf83d7ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58d88f85-1d15-4f12-a8e7-f3b531088d5e", "tag": "8dcff3a2-5327-4c3f-9f70-590bf220865d"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:32:23.158403 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:32:23.158403 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:32:23.175059 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4b9181c5-8717-47ad-82be-8b3f7ec44379 req-8407fe32-b222-4f3a-a494-1cbcf83d7ef8 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:23.176342 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4b9181c5-8717-47ad-82be-8b3f7ec44379 req-8407fe32-b222-4f3a-a494-1cbcf83d7ef8 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:23.208248 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-4b9181c5-8717-47ad-82be-8b3f7ec44379 req-8407fe32-b222-4f3a-a494-1cbcf83d7ef8 service nova] Creating event network-changed:8dcff3a2-5327-4c3f-9f70-590bf220865d for instance 58d88f85-1d15-4f12-a8e7-f3b531088d5e on hv-cinder-81322 Feb 21 01:32:23.210823 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4b9181c5-8717-47ad-82be-8b3f7ec44379 req-8407fe32-b222-4f3a-a494-1cbcf83d7ef8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 21 01:32:23.214572 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f081e5e-4390-429d-a691-f25f27816ab4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:23.215033 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f081e5e-4390-429d-a691-f25f27816ab4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:23.215872 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f081e5e-4390-429d-a691-f25f27816ab4 None None] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:23.224854 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f081e5e-4390-429d-a691-f25f27816ab4 None None] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:23.228880 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.compute.rpcapi [None req-9f081e5e-4390-429d-a691-f25f27816ab4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 21 01:32:23.230655 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f081e5e-4390-429d-a691-f25f27816ab4 None None] Releasing lock "compute-rpcapi-router" {{(pid=123542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 21 01:32:23.259063 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9f081e5e-4390-429d-a691-f25f27816ab4 None None] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201334 Feb 21 01:32:23.260468 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 30/56] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:32:23.266362 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-3ae53568-22bf-40d5-8e07-b78fa8bca209 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:23.274301 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3ae53568-22bf-40d5-8e07-b78fa8bca209 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.240130 Feb 21 01:32:23.275764 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 27/57] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:23 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:23.283672 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-856eab2d-1b65-4b53-a662-8fb924022bf3 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:23.284563 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-856eab2d-1b65-4b53-a662-8fb924022bf3 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:23.292724 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-856eab2d-1b65-4b53-a662-8fb924022bf3 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:23.293584 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-856eab2d-1b65-4b53-a662-8fb924022bf3 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:23.294594 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-856eab2d-1b65-4b53-a662-8fb924022bf3 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:23.295035 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-856eab2d-1b65-4b53-a662-8fb924022bf3 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:23.342986 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-4f07ba6e-e777-4345-9202-b9dd9ab7522d req-385956d6-d17a-4eea-895b-9abb2881b239 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d359b725-8ebc-4c70-b60b-fac888f539dc", "tag": "29ef37bc-fe8f-48e8-8a21-00801ca04b5a"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:32:23.350986 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:32:23.350986 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:32:23.377200 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4f07ba6e-e777-4345-9202-b9dd9ab7522d req-385956d6-d17a-4eea-895b-9abb2881b239 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:23.377200 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-4f07ba6e-e777-4345-9202-b9dd9ab7522d req-385956d6-d17a-4eea-895b-9abb2881b239 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:23.377200 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-4f07ba6e-e777-4345-9202-b9dd9ab7522d req-385956d6-d17a-4eea-895b-9abb2881b239 service nova] Creating event network-changed:29ef37bc-fe8f-48e8-8a21-00801ca04b5a for instance d359b725-8ebc-4c70-b60b-fac888f539dc on hv-cinder-81322 Feb 21 01:32:23.386574 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-4f07ba6e-e777-4345-9202-b9dd9ab7522d req-385956d6-d17a-4eea-895b-9abb2881b239 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122852 Feb 21 01:32:23.387874 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 31/58] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:32:23.395526 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a465d5fa-ffb2-4103-b08a-2b3089c68eda tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:23.396275 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a465d5fa-ffb2-4103-b08a-2b3089c68eda tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:23.465739 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-a465d5fa-ffb2-4103-b08a-2b3089c68eda tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:23.478402 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-a465d5fa-ffb2-4103-b08a-2b3089c68eda tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:23.478402 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-a465d5fa-ffb2-4103-b08a-2b3089c68eda tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:23.478829 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a465d5fa-ffb2-4103-b08a-2b3089c68eda tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1280 microversion: 2.20 time: 0.089008 Feb 21 01:32:23.479984 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 32/59] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:23 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1280 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:32:23.484032 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-856eab2d-1b65-4b53-a662-8fb924022bf3 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:23.484822 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-db4a6484-8cd1-42c6-adf0-8c7914c9344a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:23.485577 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-db4a6484-8cd1-42c6-adf0-8c7914c9344a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:23.491560 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-856eab2d-1b65-4b53-a662-8fb924022bf3 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.214652 Feb 21 01:32:23.492140 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 28/60] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:23 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:23.547633 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-db4a6484-8cd1-42c6-adf0-8c7914c9344a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:23.555214 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-db4a6484-8cd1-42c6-adf0-8c7914c9344a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1236 microversion: 2.1 time: 0.073853 Feb 21 01:32:23.558460 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 33/61] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:23 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1236 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:24.051521 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1384a78e-0ade-4887-8238-27d4b393bb02 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:24.052165 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1384a78e-0ade-4887-8238-27d4b393bb02 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:24.058640 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1384a78e-0ade-4887-8238-27d4b393bb02 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:24.059143 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1384a78e-0ade-4887-8238-27d4b393bb02 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:24.060714 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1384a78e-0ade-4887-8238-27d4b393bb02 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:24.061343 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1384a78e-0ade-4887-8238-27d4b393bb02 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:24.163172 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1384a78e-0ade-4887-8238-27d4b393bb02 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:24.173152 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1384a78e-0ade-4887-8238-27d4b393bb02 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1282 microversion: 2.1 time: 0.125193 Feb 21 01:32:24.174627 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 29/62] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:24 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1282 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:24.291027 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-69684427-88ea-490e-90b8-0f4df64ccbb5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:24.291654 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-69684427-88ea-490e-90b8-0f4df64ccbb5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:24.298174 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69684427-88ea-490e-90b8-0f4df64ccbb5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:24.298626 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69684427-88ea-490e-90b8-0f4df64ccbb5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:24.299405 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69684427-88ea-490e-90b8-0f4df64ccbb5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:24.299842 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69684427-88ea-490e-90b8-0f4df64ccbb5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:24.439240 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-69684427-88ea-490e-90b8-0f4df64ccbb5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:24.446825 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-69684427-88ea-490e-90b8-0f4df64ccbb5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.159426 Feb 21 01:32:24.447398 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 34/63] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:24 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:24.497692 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-18ea52ec-ea3c-4fb7-834d-cde08b17bfff tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:24.498241 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-18ea52ec-ea3c-4fb7-834d-cde08b17bfff tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:24.508534 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-899bbe8a-e870-4f1b-a6e5-3680a49566ae tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:24.509247 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-899bbe8a-e870-4f1b-a6e5-3680a49566ae tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:24.513162 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18ea52ec-ea3c-4fb7-834d-cde08b17bfff tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:24.513617 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18ea52ec-ea3c-4fb7-834d-cde08b17bfff tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:24.514407 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18ea52ec-ea3c-4fb7-834d-cde08b17bfff tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:24.514848 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18ea52ec-ea3c-4fb7-834d-cde08b17bfff tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:24.522020 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-899bbe8a-e870-4f1b-a6e5-3680a49566ae tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:24.522503 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-899bbe8a-e870-4f1b-a6e5-3680a49566ae tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:24.523577 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-899bbe8a-e870-4f1b-a6e5-3680a49566ae tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:24.524240 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-899bbe8a-e870-4f1b-a6e5-3680a49566ae tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:24.591923 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-18ea52ec-ea3c-4fb7-834d-cde08b17bfff tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:24.601284 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-18ea52ec-ea3c-4fb7-834d-cde08b17bfff tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:24.603267 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-18ea52ec-ea3c-4fb7-834d-cde08b17bfff tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:24.604612 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-18ea52ec-ea3c-4fb7-834d-cde08b17bfff tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1284 microversion: 2.20 time: 0.110697 Feb 21 01:32:24.605637 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 30/64] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:24 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:32:24.620086 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7bbc650e-7257-4b14-914c-6bb585144977 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:24.621052 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7bbc650e-7257-4b14-914c-6bb585144977 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:24.641653 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bbc650e-7257-4b14-914c-6bb585144977 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:24.642553 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bbc650e-7257-4b14-914c-6bb585144977 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:24.644137 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bbc650e-7257-4b14-914c-6bb585144977 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:24.644941 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bbc650e-7257-4b14-914c-6bb585144977 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:24.747118 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-7bbc650e-7257-4b14-914c-6bb585144977 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:24.761655 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7bbc650e-7257-4b14-914c-6bb585144977 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1240 microversion: 2.1 time: 0.147714 Feb 21 01:32:24.761655 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 31/65] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:24 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1240 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:24.785821 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-899bbe8a-e870-4f1b-a6e5-3680a49566ae tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:24.794346 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-899bbe8a-e870-4f1b-a6e5-3680a49566ae tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.289606 Feb 21 01:32:24.795287 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 35/66] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:24 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:25.196579 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0b994e7f-48ed-407e-b539-8a75758edff1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:25.197186 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0b994e7f-48ed-407e-b539-8a75758edff1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:25.203598 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b994e7f-48ed-407e-b539-8a75758edff1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:25.204040 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b994e7f-48ed-407e-b539-8a75758edff1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:25.204871 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b994e7f-48ed-407e-b539-8a75758edff1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:25.205292 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0b994e7f-48ed-407e-b539-8a75758edff1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:25.262447 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-0b994e7f-48ed-407e-b539-8a75758edff1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:25.270108 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0b994e7f-48ed-407e-b539-8a75758edff1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1282 microversion: 2.1 time: 0.077157 Feb 21 01:32:25.270662 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 32/67] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:25 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1282 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:25.465384 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2a4ae4e2-f774-42c9-98d3-a152f8f11e89 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:25.465938 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2a4ae4e2-f774-42c9-98d3-a152f8f11e89 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:25.472310 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a4ae4e2-f774-42c9-98d3-a152f8f11e89 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:25.472810 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a4ae4e2-f774-42c9-98d3-a152f8f11e89 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:25.473599 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a4ae4e2-f774-42c9-98d3-a152f8f11e89 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:25.474029 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a4ae4e2-f774-42c9-98d3-a152f8f11e89 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:25.624956 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-2a4ae4e2-f774-42c9-98d3-a152f8f11e89 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:25.625149 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5cf96fe7-9fa5-40ed-957a-d76eec46f1be tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:25.625582 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5cf96fe7-9fa5-40ed-957a-d76eec46f1be tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:25.631363 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cf96fe7-9fa5-40ed-957a-d76eec46f1be tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:25.635848 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cf96fe7-9fa5-40ed-957a-d76eec46f1be tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:25.635986 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2a4ae4e2-f774-42c9-98d3-a152f8f11e89 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.171305 Feb 21 01:32:25.636095 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cf96fe7-9fa5-40ed-957a-d76eec46f1be tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:25.636095 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cf96fe7-9fa5-40ed-957a-d76eec46f1be tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:25.636253 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 36/68] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:25 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:25.692468 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-5cf96fe7-9fa5-40ed-957a-d76eec46f1be tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:25.700075 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-5cf96fe7-9fa5-40ed-957a-d76eec46f1be tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:25.701807 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-5cf96fe7-9fa5-40ed-957a-d76eec46f1be tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:25.703034 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5cf96fe7-9fa5-40ed-957a-d76eec46f1be tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1284 microversion: 2.20 time: 0.082506 Feb 21 01:32:25.703606 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 33/69] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:25 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1284 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:32:25.773478 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d2ee75a7-a63f-4455-abc3-a89df62f053d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:25.779241 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d2ee75a7-a63f-4455-abc3-a89df62f053d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:25.779903 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2ee75a7-a63f-4455-abc3-a89df62f053d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:25.780350 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2ee75a7-a63f-4455-abc3-a89df62f053d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:25.781157 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2ee75a7-a63f-4455-abc3-a89df62f053d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:25.781625 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2ee75a7-a63f-4455-abc3-a89df62f053d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:25.816579 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5d8eb1aa-d11c-43e6-b1cb-cc88d1a22d21 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:25.817309 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5d8eb1aa-d11c-43e6-b1cb-cc88d1a22d21 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:25.825986 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d8eb1aa-d11c-43e6-b1cb-cc88d1a22d21 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:25.826519 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d8eb1aa-d11c-43e6-b1cb-cc88d1a22d21 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:25.827366 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d8eb1aa-d11c-43e6-b1cb-cc88d1a22d21 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:25.827992 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d8eb1aa-d11c-43e6-b1cb-cc88d1a22d21 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:25.846206 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-d2ee75a7-a63f-4455-abc3-a89df62f053d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:25.854393 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d2ee75a7-a63f-4455-abc3-a89df62f053d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1240 microversion: 2.1 time: 0.084477 Feb 21 01:32:25.855369 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 37/70] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:25 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:25.989928 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-5d8eb1aa-d11c-43e6-b1cb-cc88d1a22d21 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:25.996417 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5d8eb1aa-d11c-43e6-b1cb-cc88d1a22d21 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.183408 Feb 21 01:32:25.997002 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 34/71] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:25 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:26.286904 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c105c92f-d0d5-46c2-80fe-e0161af96a3d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:26.287512 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c105c92f-d0d5-46c2-80fe-e0161af96a3d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:26.298001 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c105c92f-d0d5-46c2-80fe-e0161af96a3d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:26.298468 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c105c92f-d0d5-46c2-80fe-e0161af96a3d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:26.299250 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c105c92f-d0d5-46c2-80fe-e0161af96a3d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:26.299680 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c105c92f-d0d5-46c2-80fe-e0161af96a3d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:26.373666 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c105c92f-d0d5-46c2-80fe-e0161af96a3d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:26.380887 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c105c92f-d0d5-46c2-80fe-e0161af96a3d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1282 microversion: 2.1 time: 0.097853 Feb 21 01:32:26.381439 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 38/72] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:26 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1282 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:26.650525 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-54fa020d-0a00-453a-a698-512f0dbe6f68 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:26.651138 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-54fa020d-0a00-453a-a698-512f0dbe6f68 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:26.657038 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-54fa020d-0a00-453a-a698-512f0dbe6f68 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:26.657487 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-54fa020d-0a00-453a-a698-512f0dbe6f68 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:26.658253 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-54fa020d-0a00-453a-a698-512f0dbe6f68 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:26.658685 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-54fa020d-0a00-453a-a698-512f0dbe6f68 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:26.721584 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-31c30146-9037-450f-8f98-434e7a419c09 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:26.722198 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-31c30146-9037-450f-8f98-434e7a419c09 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:26.727844 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31c30146-9037-450f-8f98-434e7a419c09 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:26.728284 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31c30146-9037-450f-8f98-434e7a419c09 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:26.729080 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31c30146-9037-450f-8f98-434e7a419c09 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:26.729510 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-31c30146-9037-450f-8f98-434e7a419c09 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:26.799880 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-31c30146-9037-450f-8f98-434e7a419c09 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:26.807452 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-31c30146-9037-450f-8f98-434e7a419c09 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:26.808990 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-31c30146-9037-450f-8f98-434e7a419c09 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:26.810629 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-31c30146-9037-450f-8f98-434e7a419c09 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1284 microversion: 2.20 time: 0.092218 Feb 21 01:32:26.811372 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 39/73] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:26 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:32:26.819517 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-54fa020d-0a00-453a-a698-512f0dbe6f68 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:26.828450 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-54fa020d-0a00-453a-a698-512f0dbe6f68 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.181420 Feb 21 01:32:26.829352 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 35/74] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:26 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:26.871205 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-399d974c-482c-4404-b1d2-ae364d4b6067 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:26.871850 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-399d974c-482c-4404-b1d2-ae364d4b6067 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:26.878757 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-399d974c-482c-4404-b1d2-ae364d4b6067 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:26.879344 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-399d974c-482c-4404-b1d2-ae364d4b6067 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:26.880287 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-399d974c-482c-4404-b1d2-ae364d4b6067 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:26.880848 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-399d974c-482c-4404-b1d2-ae364d4b6067 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:27.022037 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1d0e3242-2eb4-4733-9a07-a9eb44c0beaf tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:27.022652 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1d0e3242-2eb4-4733-9a07-a9eb44c0beaf tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:27.028776 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d0e3242-2eb4-4733-9a07-a9eb44c0beaf tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:27.029225 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d0e3242-2eb4-4733-9a07-a9eb44c0beaf tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:27.030015 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d0e3242-2eb4-4733-9a07-a9eb44c0beaf tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:27.030447 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1d0e3242-2eb4-4733-9a07-a9eb44c0beaf tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:27.081879 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-399d974c-482c-4404-b1d2-ae364d4b6067 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:27.089742 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-399d974c-482c-4404-b1d2-ae364d4b6067 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1240 microversion: 2.1 time: 0.222332 Feb 21 01:32:27.090317 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 40/75] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:26 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1240 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:27.176562 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1d0e3242-2eb4-4733-9a07-a9eb44c0beaf tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:27.183681 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1d0e3242-2eb4-4733-9a07-a9eb44c0beaf tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.165364 Feb 21 01:32:27.184241 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 36/76] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:27 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:27.397824 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-386cb178-8314-4381-bf0b-a789be5d2e2b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:27.398371 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-386cb178-8314-4381-bf0b-a789be5d2e2b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:27.406669 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-386cb178-8314-4381-bf0b-a789be5d2e2b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:27.407476 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-386cb178-8314-4381-bf0b-a789be5d2e2b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:27.408623 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-386cb178-8314-4381-bf0b-a789be5d2e2b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:27.409056 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-386cb178-8314-4381-bf0b-a789be5d2e2b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:27.471465 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-386cb178-8314-4381-bf0b-a789be5d2e2b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:27.479351 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-386cb178-8314-4381-bf0b-a789be5d2e2b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1282 microversion: 2.1 time: 0.085097 Feb 21 01:32:27.480516 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 41/77] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:27 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1282 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:27.828180 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4c5b767c-f7cf-4cf1-853c-d0986d4fd0c6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:27.830485 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4c5b767c-f7cf-4cf1-853c-d0986d4fd0c6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:27.834666 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c5b767c-f7cf-4cf1-853c-d0986d4fd0c6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:27.835115 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c5b767c-f7cf-4cf1-853c-d0986d4fd0c6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:27.835920 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c5b767c-f7cf-4cf1-853c-d0986d4fd0c6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:27.836349 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4c5b767c-f7cf-4cf1-853c-d0986d4fd0c6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:27.845332 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a27598aa-9569-4b6e-8d8b-5e4a0ed43aa5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:27.845939 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a27598aa-9569-4b6e-8d8b-5e4a0ed43aa5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:27.851942 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a27598aa-9569-4b6e-8d8b-5e4a0ed43aa5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:27.852391 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a27598aa-9569-4b6e-8d8b-5e4a0ed43aa5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:27.853204 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a27598aa-9569-4b6e-8d8b-5e4a0ed43aa5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:27.853639 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a27598aa-9569-4b6e-8d8b-5e4a0ed43aa5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:27.899943 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-4c5b767c-f7cf-4cf1-853c-d0986d4fd0c6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:27.907780 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-4c5b767c-f7cf-4cf1-853c-d0986d4fd0c6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:27.909319 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-4c5b767c-f7cf-4cf1-853c-d0986d4fd0c6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:27.910411 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4c5b767c-f7cf-4cf1-853c-d0986d4fd0c6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1284 microversion: 2.20 time: 0.086058 Feb 21 01:32:27.910979 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 37/78] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:27 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:32:27.996643 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-a27598aa-9569-4b6e-8d8b-5e4a0ed43aa5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:28.004409 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a27598aa-9569-4b6e-8d8b-5e4a0ed43aa5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.163020 Feb 21 01:32:28.004995 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 42/79] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:27 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:28.106285 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7f94c3dc-c6e2-45bc-af40-3aa55bf87c9a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:28.107657 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7f94c3dc-c6e2-45bc-af40-3aa55bf87c9a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:28.117191 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f94c3dc-c6e2-45bc-af40-3aa55bf87c9a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:28.117645 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f94c3dc-c6e2-45bc-af40-3aa55bf87c9a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:28.118422 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f94c3dc-c6e2-45bc-af40-3aa55bf87c9a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:28.118854 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f94c3dc-c6e2-45bc-af40-3aa55bf87c9a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:28.180780 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-7f94c3dc-c6e2-45bc-af40-3aa55bf87c9a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:28.187909 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7f94c3dc-c6e2-45bc-af40-3aa55bf87c9a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1240 microversion: 2.1 time: 0.085272 Feb 21 01:32:28.188501 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 38/80] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:28 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:28.200555 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ba0a1b3b-53df-4a57-9339-14e14179a1b8 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:28.201200 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ba0a1b3b-53df-4a57-9339-14e14179a1b8 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:28.207007 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ba0a1b3b-53df-4a57-9339-14e14179a1b8 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:28.207462 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ba0a1b3b-53df-4a57-9339-14e14179a1b8 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:28.208234 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ba0a1b3b-53df-4a57-9339-14e14179a1b8 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:28.208692 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ba0a1b3b-53df-4a57-9339-14e14179a1b8 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:28.339566 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ba0a1b3b-53df-4a57-9339-14e14179a1b8 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:28.347276 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ba0a1b3b-53df-4a57-9339-14e14179a1b8 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.150308 Feb 21 01:32:28.347832 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 43/81] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:28 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:28.497163 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8f8ae24c-d4e8-4028-93f0-99cc4480686c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:28.497895 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8f8ae24c-d4e8-4028-93f0-99cc4480686c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:28.503564 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f8ae24c-d4e8-4028-93f0-99cc4480686c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:28.504005 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f8ae24c-d4e8-4028-93f0-99cc4480686c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:28.504789 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f8ae24c-d4e8-4028-93f0-99cc4480686c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:28.505216 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f8ae24c-d4e8-4028-93f0-99cc4480686c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:28.566526 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-8f8ae24c-d4e8-4028-93f0-99cc4480686c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:28.573835 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8f8ae24c-d4e8-4028-93f0-99cc4480686c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1282 microversion: 2.1 time: 0.080243 Feb 21 01:32:28.574604 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 39/82] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:28 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1282 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:28.929465 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b6c1cf53-aaa7-44cf-a3a8-b42582608a4a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:28.932236 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b6c1cf53-aaa7-44cf-a3a8-b42582608a4a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:28.948361 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6c1cf53-aaa7-44cf-a3a8-b42582608a4a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:28.948361 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6c1cf53-aaa7-44cf-a3a8-b42582608a4a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:28.949605 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6c1cf53-aaa7-44cf-a3a8-b42582608a4a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:28.950281 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6c1cf53-aaa7-44cf-a3a8-b42582608a4a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:29.022095 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a335c95b-5104-4018-89f9-22a8a9b7c5bd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:29.023281 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a335c95b-5104-4018-89f9-22a8a9b7c5bd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:29.030470 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a335c95b-5104-4018-89f9-22a8a9b7c5bd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:29.032274 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a335c95b-5104-4018-89f9-22a8a9b7c5bd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:29.034199 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a335c95b-5104-4018-89f9-22a8a9b7c5bd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:29.043082 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a335c95b-5104-4018-89f9-22a8a9b7c5bd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:29.188769 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-b6c1cf53-aaa7-44cf-a3a8-b42582608a4a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:29.204614 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-b6c1cf53-aaa7-44cf-a3a8-b42582608a4a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:29.207328 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-b6c1cf53-aaa7-44cf-a3a8-b42582608a4a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:29.210892 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b6c1cf53-aaa7-44cf-a3a8-b42582608a4a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1284 microversion: 2.20 time: 0.285258 Feb 21 01:32:29.222857 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 44/83] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:28 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1284 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:32:29.222857 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b1462e3b-e06a-4c05-8a38-63f5268fea2c tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:29.222857 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b1462e3b-e06a-4c05-8a38-63f5268fea2c tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:29.233489 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b1462e3b-e06a-4c05-8a38-63f5268fea2c tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:29.248087 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b1462e3b-e06a-4c05-8a38-63f5268fea2c tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:29.248087 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b1462e3b-e06a-4c05-8a38-63f5268fea2c tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:29.248087 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b1462e3b-e06a-4c05-8a38-63f5268fea2c tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:29.329295 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-b1462e3b-e06a-4c05-8a38-63f5268fea2c tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:29.342136 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b1462e3b-e06a-4c05-8a38-63f5268fea2c tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1232 microversion: 2.1 time: 0.127366 Feb 21 01:32:29.344445 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 45/84] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:29 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1232 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:29.363891 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b5efb156-ce61-4069-ab67-e3caeda85853 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:29.364666 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b5efb156-ce61-4069-ab67-e3caeda85853 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:29.379582 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5efb156-ce61-4069-ab67-e3caeda85853 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:29.380750 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5efb156-ce61-4069-ab67-e3caeda85853 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:29.382234 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5efb156-ce61-4069-ab67-e3caeda85853 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:29.382925 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5efb156-ce61-4069-ab67-e3caeda85853 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:29.745200 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-a335c95b-5104-4018-89f9-22a8a9b7c5bd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:29.754799 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a335c95b-5104-4018-89f9-22a8a9b7c5bd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.736176 Feb 21 01:32:29.757286 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 40/85] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:29 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:29.779176 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-41089589-f301-433f-bc96-745f47065140 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:29.779176 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-41089589-f301-433f-bc96-745f47065140 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:29.790481 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41089589-f301-433f-bc96-745f47065140 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:29.792099 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41089589-f301-433f-bc96-745f47065140 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:29.795084 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41089589-f301-433f-bc96-745f47065140 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:29.795978 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41089589-f301-433f-bc96-745f47065140 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:29.913903 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-41089589-f301-433f-bc96-745f47065140 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:29.929450 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-b5efb156-ce61-4069-ab67-e3caeda85853 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:29.933396 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-41089589-f301-433f-bc96-745f47065140 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1280 microversion: 2.1 time: 0.174157 Feb 21 01:32:29.936172 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 41/86] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:29 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1280 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:29.937997 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b5efb156-ce61-4069-ab67-e3caeda85853 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.578184 Feb 21 01:32:29.938565 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 46/87] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:29 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:30.230526 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aed183e1-7ced-449d-8b30-3f9dda214eb7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:30.231253 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-aed183e1-7ced-449d-8b30-3f9dda214eb7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:30.240182 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aed183e1-7ced-449d-8b30-3f9dda214eb7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:30.242062 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aed183e1-7ced-449d-8b30-3f9dda214eb7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:30.244791 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aed183e1-7ced-449d-8b30-3f9dda214eb7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:30.246000 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aed183e1-7ced-449d-8b30-3f9dda214eb7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:30.349485 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-06a05dd3-1c3d-4773-975a-d63d6f0bc9cc req-d9b613cf-49b9-4852-ace0-d649a72e7d1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5323990-b38c-44dd-812e-e5b7b3fd1ea9", "tag": "cf21197e-c8ae-4d32-9844-138c1e440316"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:32:30.351640 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:32:30.351640 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:32:30.369118 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-06a05dd3-1c3d-4773-975a-d63d6f0bc9cc req-d9b613cf-49b9-4852-ace0-d649a72e7d1d service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:30.369829 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-06a05dd3-1c3d-4773-975a-d63d6f0bc9cc req-d9b613cf-49b9-4852-ace0-d649a72e7d1d service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:30.395291 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-06a05dd3-1c3d-4773-975a-d63d6f0bc9cc req-d9b613cf-49b9-4852-ace0-d649a72e7d1d service nova] Creating event network-changed:cf21197e-c8ae-4d32-9844-138c1e440316 for instance c5323990-b38c-44dd-812e-e5b7b3fd1ea9 on hv-cinder-81322 Feb 21 01:32:30.410244 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-06a05dd3-1c3d-4773-975a-d63d6f0bc9cc req-d9b613cf-49b9-4852-ace0-d649a72e7d1d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064363 Feb 21 01:32:30.414563 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 47/88] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:32:30.416663 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-59d1107d-c623-4384-9c0c-9e8e04969323 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:30.417519 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-59d1107d-c623-4384-9c0c-9e8e04969323 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:30.429295 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59d1107d-c623-4384-9c0c-9e8e04969323 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:30.432865 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59d1107d-c623-4384-9c0c-9e8e04969323 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:30.434233 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59d1107d-c623-4384-9c0c-9e8e04969323 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:30.435385 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59d1107d-c623-4384-9c0c-9e8e04969323 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:30.602899 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-aed183e1-7ced-449d-8b30-3f9dda214eb7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:30.615039 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-aed183e1-7ced-449d-8b30-3f9dda214eb7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:30.626216 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-aed183e1-7ced-449d-8b30-3f9dda214eb7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:30.627411 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-aed183e1-7ced-449d-8b30-3f9dda214eb7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1340 microversion: 2.20 time: 0.400845 Feb 21 01:32:30.628046 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 42/89] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:30 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1340 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:32:30.643752 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-59d1107d-c623-4384-9c0c-9e8e04969323 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:30.654276 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-59d1107d-c623-4384-9c0c-9e8e04969323 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1296 microversion: 2.1 time: 0.241668 Feb 21 01:32:30.655406 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 48/90] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:30 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1296 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:30.773864 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c54ab5ae-a39c-4cf4-8f61-8d04cd0be59a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:30.774633 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c54ab5ae-a39c-4cf4-8f61-8d04cd0be59a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:30.780899 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c54ab5ae-a39c-4cf4-8f61-8d04cd0be59a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:30.783201 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c54ab5ae-a39c-4cf4-8f61-8d04cd0be59a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:30.783201 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c54ab5ae-a39c-4cf4-8f61-8d04cd0be59a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:30.783201 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c54ab5ae-a39c-4cf4-8f61-8d04cd0be59a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:30.953091 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-46469864-369b-427d-ac83-7fc5d8034f09 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:30.954334 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-46469864-369b-427d-ac83-7fc5d8034f09 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:30.961098 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46469864-369b-427d-ac83-7fc5d8034f09 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:30.962341 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46469864-369b-427d-ac83-7fc5d8034f09 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:30.963040 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46469864-369b-427d-ac83-7fc5d8034f09 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:30.963828 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46469864-369b-427d-ac83-7fc5d8034f09 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:31.419595 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-c54ab5ae-a39c-4cf4-8f61-8d04cd0be59a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:31.427677 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c54ab5ae-a39c-4cf4-8f61-8d04cd0be59a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.658288 Feb 21 01:32:31.428972 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 43/91] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:30 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:31.433480 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6db564bf-c07f-4e41-b78f-e7ac1121d3df tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:31.434470 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6db564bf-c07f-4e41-b78f-e7ac1121d3df tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:31.440858 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6db564bf-c07f-4e41-b78f-e7ac1121d3df tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:31.441505 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6db564bf-c07f-4e41-b78f-e7ac1121d3df tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:31.442465 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6db564bf-c07f-4e41-b78f-e7ac1121d3df tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:31.442892 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6db564bf-c07f-4e41-b78f-e7ac1121d3df tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:31.544376 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-46469864-369b-427d-ac83-7fc5d8034f09 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:31.558105 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-46469864-369b-427d-ac83-7fc5d8034f09 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1322 microversion: 2.1 time: 0.609229 Feb 21 01:32:31.568096 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 49/92] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:30 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1322 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:31.650095 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2f28c56f-98d4-4df0-b2d7-273e405bb72a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:31.651022 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2f28c56f-98d4-4df0-b2d7-273e405bb72a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:31.657455 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f28c56f-98d4-4df0-b2d7-273e405bb72a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:31.657903 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f28c56f-98d4-4df0-b2d7-273e405bb72a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:31.658870 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f28c56f-98d4-4df0-b2d7-273e405bb72a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:31.659308 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f28c56f-98d4-4df0-b2d7-273e405bb72a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:31.673278 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-6db564bf-c07f-4e41-b78f-e7ac1121d3df tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:31.686206 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6db564bf-c07f-4e41-b78f-e7ac1121d3df tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.255790 Feb 21 01:32:31.690163 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 44/93] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:31 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:31.694140 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-34c6c68c-e7c8-49d6-8fe5-7f4ddc36cfc8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:31.694760 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-34c6c68c-e7c8-49d6-8fe5-7f4ddc36cfc8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:31.709915 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34c6c68c-e7c8-49d6-8fe5-7f4ddc36cfc8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:31.710372 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34c6c68c-e7c8-49d6-8fe5-7f4ddc36cfc8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:31.711226 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34c6c68c-e7c8-49d6-8fe5-7f4ddc36cfc8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:31.711665 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34c6c68c-e7c8-49d6-8fe5-7f4ddc36cfc8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:31.830002 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-2f28c56f-98d4-4df0-b2d7-273e405bb72a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:31.843433 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-2f28c56f-98d4-4df0-b2d7-273e405bb72a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:31.851825 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-2f28c56f-98d4-4df0-b2d7-273e405bb72a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:31.854979 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2f28c56f-98d4-4df0-b2d7-273e405bb72a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1338 microversion: 2.20 time: 0.208716 Feb 21 01:32:31.862554 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 50/94] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:31 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1338 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:32:32.030125 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-34c6c68c-e7c8-49d6-8fe5-7f4ddc36cfc8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:32.038546 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-34c6c68c-e7c8-49d6-8fe5-7f4ddc36cfc8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1362 microversion: 2.1 time: 0.350705 Feb 21 01:32:32.039355 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 45/95] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:31 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1362 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:32.444413 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-97666020-3503-4e74-9373-071dcb164951 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:32.445072 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-97666020-3503-4e74-9373-071dcb164951 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:32.450686 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97666020-3503-4e74-9373-071dcb164951 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:32.451123 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97666020-3503-4e74-9373-071dcb164951 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:32.451884 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97666020-3503-4e74-9373-071dcb164951 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:32.452312 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97666020-3503-4e74-9373-071dcb164951 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:32.574360 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1e6f647b-529b-4e45-b346-0133006ddfae tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:32.575062 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1e6f647b-529b-4e45-b346-0133006ddfae tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:32.581227 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e6f647b-529b-4e45-b346-0133006ddfae tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:32.581866 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e6f647b-529b-4e45-b346-0133006ddfae tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:32.582801 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e6f647b-529b-4e45-b346-0133006ddfae tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:32.583392 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e6f647b-529b-4e45-b346-0133006ddfae tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:32.596236 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-97666020-3503-4e74-9373-071dcb164951 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:32.605573 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-97666020-3503-4e74-9373-071dcb164951 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.164810 Feb 21 01:32:32.618353 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 51/96] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:32 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:32.702126 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-eaf5b55f-4705-46a0-86fe-77b4383ed88f tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:32.702648 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-eaf5b55f-4705-46a0-86fe-77b4383ed88f tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:32.708462 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eaf5b55f-4705-46a0-86fe-77b4383ed88f tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:32.712453 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eaf5b55f-4705-46a0-86fe-77b4383ed88f tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:32.712453 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eaf5b55f-4705-46a0-86fe-77b4383ed88f tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:32.712453 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eaf5b55f-4705-46a0-86fe-77b4383ed88f tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:32.740793 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1e6f647b-529b-4e45-b346-0133006ddfae tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:32.748165 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1e6f647b-529b-4e45-b346-0133006ddfae tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1322 microversion: 2.1 time: 0.177692 Feb 21 01:32:32.752553 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 46/97] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:32 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:32.844132 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-eaf5b55f-4705-46a0-86fe-77b4383ed88f tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:32.851357 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-eaf5b55f-4705-46a0-86fe-77b4383ed88f tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.152932 Feb 21 01:32:32.851912 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 52/98] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:32 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:32.878176 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1bc4092d-ed01-40f8-9567-7d4a48ddd71a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:32.878862 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1bc4092d-ed01-40f8-9567-7d4a48ddd71a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:32.888816 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1bc4092d-ed01-40f8-9567-7d4a48ddd71a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:32.889339 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1bc4092d-ed01-40f8-9567-7d4a48ddd71a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:32.890197 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1bc4092d-ed01-40f8-9567-7d4a48ddd71a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:32.890700 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1bc4092d-ed01-40f8-9567-7d4a48ddd71a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:33.019739 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1bc4092d-ed01-40f8-9567-7d4a48ddd71a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:33.027385 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1bc4092d-ed01-40f8-9567-7d4a48ddd71a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:33.029509 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1bc4092d-ed01-40f8-9567-7d4a48ddd71a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:33.030590 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1bc4092d-ed01-40f8-9567-7d4a48ddd71a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1406 microversion: 2.20 time: 0.156033 Feb 21 01:32:33.031143 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 47/99] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:32 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:32:33.055405 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9525a94f-a1fc-4a93-a756-9a9e8e0db340 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:33.056220 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9525a94f-a1fc-4a93-a756-9a9e8e0db340 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:33.061900 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9525a94f-a1fc-4a93-a756-9a9e8e0db340 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:33.062346 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9525a94f-a1fc-4a93-a756-9a9e8e0db340 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:33.063137 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9525a94f-a1fc-4a93-a756-9a9e8e0db340 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:33.063546 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9525a94f-a1fc-4a93-a756-9a9e8e0db340 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:33.194802 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-9525a94f-a1fc-4a93-a756-9a9e8e0db340 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:33.202661 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9525a94f-a1fc-4a93-a756-9a9e8e0db340 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1362 microversion: 2.1 time: 0.150933 Feb 21 01:32:33.203298 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 53/100] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:33 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:33.627283 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-366b9fdf-a05c-4ef2-ad5f-f56686e3ca09 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:33.627885 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-366b9fdf-a05c-4ef2-ad5f-f56686e3ca09 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:33.634105 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-366b9fdf-a05c-4ef2-ad5f-f56686e3ca09 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:33.638489 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-366b9fdf-a05c-4ef2-ad5f-f56686e3ca09 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:33.638489 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-366b9fdf-a05c-4ef2-ad5f-f56686e3ca09 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:33.638489 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-366b9fdf-a05c-4ef2-ad5f-f56686e3ca09 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:33.765009 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a27bf2d6-cabe-4a1a-8f64-2353912ea855 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:33.765631 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a27bf2d6-cabe-4a1a-8f64-2353912ea855 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:33.771521 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a27bf2d6-cabe-4a1a-8f64-2353912ea855 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:33.772178 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a27bf2d6-cabe-4a1a-8f64-2353912ea855 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:33.773153 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a27bf2d6-cabe-4a1a-8f64-2353912ea855 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:33.773583 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a27bf2d6-cabe-4a1a-8f64-2353912ea855 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:33.788587 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-366b9fdf-a05c-4ef2-ad5f-f56686e3ca09 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:33.796843 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-366b9fdf-a05c-4ef2-ad5f-f56686e3ca09 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.173108 Feb 21 01:32:33.797877 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 48/101] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:33 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:33.868691 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-746cd629-28bd-4f77-bfef-2568c62e5795 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:33.869302 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-746cd629-28bd-4f77-bfef-2568c62e5795 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:33.876869 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-746cd629-28bd-4f77-bfef-2568c62e5795 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:33.877744 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-746cd629-28bd-4f77-bfef-2568c62e5795 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:33.878867 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-746cd629-28bd-4f77-bfef-2568c62e5795 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:33.879309 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-746cd629-28bd-4f77-bfef-2568c62e5795 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:33.926635 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-a27bf2d6-cabe-4a1a-8f64-2353912ea855 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:33.934616 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a27bf2d6-cabe-4a1a-8f64-2353912ea855 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1322 microversion: 2.1 time: 0.173286 Feb 21 01:32:33.935841 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 54/102] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:33 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:34.049031 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-887d95dc-adbf-4e38-8688-45d77bdd97e7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:34.049656 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-887d95dc-adbf-4e38-8688-45d77bdd97e7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:34.056572 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-887d95dc-adbf-4e38-8688-45d77bdd97e7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:34.057026 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-887d95dc-adbf-4e38-8688-45d77bdd97e7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:34.059171 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-887d95dc-adbf-4e38-8688-45d77bdd97e7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:34.059171 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-887d95dc-adbf-4e38-8688-45d77bdd97e7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:34.197973 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-746cd629-28bd-4f77-bfef-2568c62e5795 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:34.205311 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-746cd629-28bd-4f77-bfef-2568c62e5795 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.340471 Feb 21 01:32:34.205876 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 49/103] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:33 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:34.219590 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1b2485c2-c8f7-4663-a150-8f8bcdb98950 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:34.220123 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1b2485c2-c8f7-4663-a150-8f8bcdb98950 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:34.226167 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b2485c2-c8f7-4663-a150-8f8bcdb98950 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:34.226831 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b2485c2-c8f7-4663-a150-8f8bcdb98950 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:34.227372 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b2485c2-c8f7-4663-a150-8f8bcdb98950 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:34.227799 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b2485c2-c8f7-4663-a150-8f8bcdb98950 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:34.322273 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-887d95dc-adbf-4e38-8688-45d77bdd97e7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:34.330498 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-887d95dc-adbf-4e38-8688-45d77bdd97e7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:34.332007 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-887d95dc-adbf-4e38-8688-45d77bdd97e7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:34.333194 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-887d95dc-adbf-4e38-8688-45d77bdd97e7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1406 microversion: 2.20 time: 0.287945 Feb 21 01:32:34.333753 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 55/104] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:34 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1406 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:32:34.389660 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1b2485c2-c8f7-4663-a150-8f8bcdb98950 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:34.396690 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1b2485c2-c8f7-4663-a150-8f8bcdb98950 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1362 microversion: 2.1 time: 0.181151 Feb 21 01:32:34.397250 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 50/105] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:34 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:34.814849 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9ad93919-b4fb-45d0-adee-09cf8303f0df tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:34.815479 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9ad93919-b4fb-45d0-adee-09cf8303f0df tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:34.823633 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ad93919-b4fb-45d0-adee-09cf8303f0df tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:34.823633 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ad93919-b4fb-45d0-adee-09cf8303f0df tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:34.823633 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ad93919-b4fb-45d0-adee-09cf8303f0df tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:34.823633 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ad93919-b4fb-45d0-adee-09cf8303f0df tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:34.952859 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bf7afc30-1f00-4201-bdee-d981aaeea3be tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:34.953468 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bf7afc30-1f00-4201-bdee-d981aaeea3be tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:34.954069 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-9ad93919-b4fb-45d0-adee-09cf8303f0df tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:34.959353 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf7afc30-1f00-4201-bdee-d981aaeea3be tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:34.959791 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf7afc30-1f00-4201-bdee-d981aaeea3be tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:34.960593 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf7afc30-1f00-4201-bdee-d981aaeea3be tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:34.961038 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf7afc30-1f00-4201-bdee-d981aaeea3be tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:34.961871 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9ad93919-b4fb-45d0-adee-09cf8303f0df tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.150618 Feb 21 01:32:34.962444 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 56/106] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:34 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:35.091671 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-bf7afc30-1f00-4201-bdee-d981aaeea3be tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:35.099102 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bf7afc30-1f00-4201-bdee-d981aaeea3be tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1322 microversion: 2.1 time: 0.150475 Feb 21 01:32:35.099678 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 51/107] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:34 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:35.221247 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5f192c4d-a08b-4b2d-abf9-dd48cb5164e5 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:35.221858 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5f192c4d-a08b-4b2d-abf9-dd48cb5164e5 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:35.227500 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f192c4d-a08b-4b2d-abf9-dd48cb5164e5 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:35.227943 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f192c4d-a08b-4b2d-abf9-dd48cb5164e5 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:35.228745 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f192c4d-a08b-4b2d-abf9-dd48cb5164e5 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:35.229176 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5f192c4d-a08b-4b2d-abf9-dd48cb5164e5 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:35.351270 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-421afc15-47a0-4dce-917c-af0629cb992d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:35.354153 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-421afc15-47a0-4dce-917c-af0629cb992d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:35.358204 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-421afc15-47a0-4dce-917c-af0629cb992d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:35.358658 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-421afc15-47a0-4dce-917c-af0629cb992d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:35.359431 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-421afc15-47a0-4dce-917c-af0629cb992d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:35.361174 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-421afc15-47a0-4dce-917c-af0629cb992d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:35.377054 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-5f192c4d-a08b-4b2d-abf9-dd48cb5164e5 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:35.384454 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5f192c4d-a08b-4b2d-abf9-dd48cb5164e5 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.166959 Feb 21 01:32:35.385020 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 57/108] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:35 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:35.415384 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e0b82696-3657-4b93-9aea-1b559a451b80 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:35.416299 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e0b82696-3657-4b93-9aea-1b559a451b80 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:35.423108 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0b82696-3657-4b93-9aea-1b559a451b80 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:35.423782 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0b82696-3657-4b93-9aea-1b559a451b80 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:35.424902 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0b82696-3657-4b93-9aea-1b559a451b80 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:35.425657 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0b82696-3657-4b93-9aea-1b559a451b80 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:35.694014 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-421afc15-47a0-4dce-917c-af0629cb992d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:35.701764 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-421afc15-47a0-4dce-917c-af0629cb992d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:35.703277 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-421afc15-47a0-4dce-917c-af0629cb992d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:35.704550 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-421afc15-47a0-4dce-917c-af0629cb992d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1406 microversion: 2.20 time: 0.357226 Feb 21 01:32:35.715391 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 52/109] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:35 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1406 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:32:35.981928 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bcac9830-1de1-4a61-be4a-5dec41a198be tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:35.983064 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-e0b82696-3657-4b93-9aea-1b559a451b80 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:35.983507 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bcac9830-1de1-4a61-be4a-5dec41a198be tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:35.994206 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e0b82696-3657-4b93-9aea-1b559a451b80 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1362 microversion: 2.1 time: 0.583403 Feb 21 01:32:35.995831 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 58/110] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:35 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1362 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:36.009260 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bcac9830-1de1-4a61-be4a-5dec41a198be tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:36.009718 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bcac9830-1de1-4a61-be4a-5dec41a198be tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:36.010515 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bcac9830-1de1-4a61-be4a-5dec41a198be tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:36.010947 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bcac9830-1de1-4a61-be4a-5dec41a198be tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:36.117593 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0a2e84bc-cf37-45bf-b260-0aa312d19b75 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:36.118226 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0a2e84bc-cf37-45bf-b260-0aa312d19b75 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:36.124047 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a2e84bc-cf37-45bf-b260-0aa312d19b75 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:36.126894 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a2e84bc-cf37-45bf-b260-0aa312d19b75 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:36.126894 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a2e84bc-cf37-45bf-b260-0aa312d19b75 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:36.126894 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a2e84bc-cf37-45bf-b260-0aa312d19b75 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:36.533648 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-bcac9830-1de1-4a61-be4a-5dec41a198be tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:36.559996 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bcac9830-1de1-4a61-be4a-5dec41a198be tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.582934 Feb 21 01:32:36.560539 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 53/111] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:35 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:36.565902 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-0a2e84bc-cf37-45bf-b260-0aa312d19b75 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:36.586305 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d0a9e266-8aad-4d30-9785-d58b612c77b6 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:36.587020 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d0a9e266-8aad-4d30-9785-d58b612c77b6 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:36.587862 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0a2e84bc-cf37-45bf-b260-0aa312d19b75 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1322 microversion: 2.1 time: 0.472360 Feb 21 01:32:36.590123 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 59/112] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:36 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1322 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:36.598561 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0a9e266-8aad-4d30-9785-d58b612c77b6 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:36.599125 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0a9e266-8aad-4d30-9785-d58b612c77b6 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:36.599653 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-573b09d9-6a21-4c01-93e3-931fea911f03 req-be13c580-b86b-4bcc-b2db-a7c2e1f69cbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff526a32-96c9-4481-a88c-a0913652acfd", "tag": "fe876a1a-56e9-4821-ac6c-94fe28a1852e"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:32:36.600153 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0a9e266-8aad-4d30-9785-d58b612c77b6 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:36.600622 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0a9e266-8aad-4d30-9785-d58b612c77b6 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:36.601713 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:32:36.601713 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:32:36.609478 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-573b09d9-6a21-4c01-93e3-931fea911f03 req-be13c580-b86b-4bcc-b2db-a7c2e1f69cbb service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:36.610516 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-573b09d9-6a21-4c01-93e3-931fea911f03 req-be13c580-b86b-4bcc-b2db-a7c2e1f69cbb service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:36.629405 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-573b09d9-6a21-4c01-93e3-931fea911f03 req-be13c580-b86b-4bcc-b2db-a7c2e1f69cbb service nova] Creating event network-changed:fe876a1a-56e9-4821-ac6c-94fe28a1852e for instance ff526a32-96c9-4481-a88c-a0913652acfd on hv-cinder-81322 Feb 21 01:32:36.635727 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-573b09d9-6a21-4c01-93e3-931fea911f03 req-be13c580-b86b-4bcc-b2db-a7c2e1f69cbb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040567 Feb 21 01:32:36.636566 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 60/113] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:32:36.725507 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-69b8ca6b-6e38-461d-aa14-90882929f91c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:36.727251 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-69b8ca6b-6e38-461d-aa14-90882929f91c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:36.735158 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69b8ca6b-6e38-461d-aa14-90882929f91c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:36.735610 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69b8ca6b-6e38-461d-aa14-90882929f91c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:36.736392 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69b8ca6b-6e38-461d-aa14-90882929f91c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:36.737011 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-69b8ca6b-6e38-461d-aa14-90882929f91c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:36.955485 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-d0a9e266-8aad-4d30-9785-d58b612c77b6 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:36.977641 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d0a9e266-8aad-4d30-9785-d58b612c77b6 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.409949 Feb 21 01:32:36.979354 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 54/114] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:36 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:37.012172 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d1f19b4c-c406-4a93-8d2c-d6e388d6f4bc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:37.013553 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d1f19b4c-c406-4a93-8d2c-d6e388d6f4bc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:37.021728 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1f19b4c-c406-4a93-8d2c-d6e388d6f4bc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:37.025041 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1f19b4c-c406-4a93-8d2c-d6e388d6f4bc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:37.026609 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1f19b4c-c406-4a93-8d2c-d6e388d6f4bc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:37.029161 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1f19b4c-c406-4a93-8d2c-d6e388d6f4bc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:37.316716 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-69b8ca6b-6e38-461d-aa14-90882929f91c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:37.333478 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-69b8ca6b-6e38-461d-aa14-90882929f91c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:37.334989 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-69b8ca6b-6e38-461d-aa14-90882929f91c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:37.336111 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-69b8ca6b-6e38-461d-aa14-90882929f91c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1406 microversion: 2.20 time: 0.616383 Feb 21 01:32:37.336707 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 61/115] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:36 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1406 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:32:37.415253 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-b9847179-b7ff-4e51-90f7-15b03da004f5 req-f919fd41-9811-41cb-a6b8-4f3e0843b115 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8", "tag": "4f6f4bf6-c2bb-4409-855b-387ebc13aa76"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:32:37.418486 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:32:37.418486 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:32:37.426539 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b9847179-b7ff-4e51-90f7-15b03da004f5 req-f919fd41-9811-41cb-a6b8-4f3e0843b115 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:37.427367 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b9847179-b7ff-4e51-90f7-15b03da004f5 req-f919fd41-9811-41cb-a6b8-4f3e0843b115 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:37.441644 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-b9847179-b7ff-4e51-90f7-15b03da004f5 req-f919fd41-9811-41cb-a6b8-4f3e0843b115 service nova] Creating event network-changed:4f6f4bf6-c2bb-4409-855b-387ebc13aa76 for instance 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 on hv-cinder-81322 Feb 21 01:32:37.446613 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-b9847179-b7ff-4e51-90f7-15b03da004f5 req-f919fd41-9811-41cb-a6b8-4f3e0843b115 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034930 Feb 21 01:32:37.447468 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 62/116] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:32:37.576893 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3731ae16-a9e7-4482-a62f-30f74509cc7d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:37.577942 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3731ae16-a9e7-4482-a62f-30f74509cc7d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:37.595494 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3731ae16-a9e7-4482-a62f-30f74509cc7d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:37.607256 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3731ae16-a9e7-4482-a62f-30f74509cc7d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:37.615326 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3731ae16-a9e7-4482-a62f-30f74509cc7d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:37.621239 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3731ae16-a9e7-4482-a62f-30f74509cc7d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:37.749210 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-d1f19b4c-c406-4a93-8d2c-d6e388d6f4bc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:37.758037 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d1f19b4c-c406-4a93-8d2c-d6e388d6f4bc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1362 microversion: 2.1 time: 0.750523 Feb 21 01:32:37.767413 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 55/117] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:37 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1362 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:37.767413 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d994f108-b15e-4df5-943c-0cdbec17a981 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:37.767413 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d994f108-b15e-4df5-943c-0cdbec17a981 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:37.774450 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d994f108-b15e-4df5-943c-0cdbec17a981 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:37.774450 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d994f108-b15e-4df5-943c-0cdbec17a981 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:37.774766 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d994f108-b15e-4df5-943c-0cdbec17a981 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:37.775089 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d994f108-b15e-4df5-943c-0cdbec17a981 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:38.158891 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-3731ae16-a9e7-4482-a62f-30f74509cc7d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:38.172468 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3731ae16-a9e7-4482-a62f-30f74509cc7d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.599653 Feb 21 01:32:38.180487 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 63/118] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:37 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:38.180809 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-55283142-f57d-48e3-97ca-f7871491a1bc tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:38.181429 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-55283142-f57d-48e3-97ca-f7871491a1bc tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:38.187444 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55283142-f57d-48e3-97ca-f7871491a1bc tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:38.187890 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55283142-f57d-48e3-97ca-f7871491a1bc tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:38.188696 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55283142-f57d-48e3-97ca-f7871491a1bc tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:38.189128 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55283142-f57d-48e3-97ca-f7871491a1bc tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:38.342063 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-d994f108-b15e-4df5-943c-0cdbec17a981 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:38.353065 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d994f108-b15e-4df5-943c-0cdbec17a981 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1322 microversion: 2.1 time: 0.593046 Feb 21 01:32:38.355771 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 56/119] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:37 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1322 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:38.360173 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0aa113b4-68e6-4108-8e74-e412e861440e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:38.361060 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0aa113b4-68e6-4108-8e74-e412e861440e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:38.367155 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0aa113b4-68e6-4108-8e74-e412e861440e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:38.367701 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0aa113b4-68e6-4108-8e74-e412e861440e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:38.368614 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0aa113b4-68e6-4108-8e74-e412e861440e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:38.369150 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0aa113b4-68e6-4108-8e74-e412e861440e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:38.624559 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-55283142-f57d-48e3-97ca-f7871491a1bc tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:38.638413 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-55283142-f57d-48e3-97ca-f7871491a1bc tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.460609 Feb 21 01:32:38.638413 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 64/120] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:38 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:38.774762 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2b5cb218-b5c6-46bd-8a78-20208cdd5783 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:38.775659 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2b5cb218-b5c6-46bd-8a78-20208cdd5783 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:38.793522 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b5cb218-b5c6-46bd-8a78-20208cdd5783 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:38.793723 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-0aa113b4-68e6-4108-8e74-e412e861440e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:38.796086 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b5cb218-b5c6-46bd-8a78-20208cdd5783 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:38.797982 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b5cb218-b5c6-46bd-8a78-20208cdd5783 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:38.799332 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b5cb218-b5c6-46bd-8a78-20208cdd5783 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:38.803393 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-0aa113b4-68e6-4108-8e74-e412e861440e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:38.805196 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-0aa113b4-68e6-4108-8e74-e412e861440e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:38.806411 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0aa113b4-68e6-4108-8e74-e412e861440e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1406 microversion: 2.20 time: 0.451578 Feb 21 01:32:38.808782 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 57/121] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:38 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1406 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:32:39.130280 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-2b5cb218-b5c6-46bd-8a78-20208cdd5783 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:39.140181 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2b5cb218-b5c6-46bd-8a78-20208cdd5783 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1362 microversion: 2.1 time: 0.368824 Feb 21 01:32:39.141049 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 65/122] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:38 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1362 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:39.189868 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2399261d-d93e-453a-ad00-6eff909fcb91 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:39.190470 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2399261d-d93e-453a-ad00-6eff909fcb91 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:39.196152 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2399261d-d93e-453a-ad00-6eff909fcb91 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:39.196630 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2399261d-d93e-453a-ad00-6eff909fcb91 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:39.197396 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2399261d-d93e-453a-ad00-6eff909fcb91 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:39.197826 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2399261d-d93e-453a-ad00-6eff909fcb91 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:39.351144 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2399261d-d93e-453a-ad00-6eff909fcb91 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:39.358725 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2399261d-d93e-453a-ad00-6eff909fcb91 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.172361 Feb 21 01:32:39.359303 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 58/123] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:39 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:39.370203 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8199dab8-36d4-4f42-9cb6-435ed1f5434f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:39.370819 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8199dab8-36d4-4f42-9cb6-435ed1f5434f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:39.383114 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8199dab8-36d4-4f42-9cb6-435ed1f5434f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:39.383629 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8199dab8-36d4-4f42-9cb6-435ed1f5434f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:39.384414 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8199dab8-36d4-4f42-9cb6-435ed1f5434f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:39.386278 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8199dab8-36d4-4f42-9cb6-435ed1f5434f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:39.471676 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-22118808-4a96-4c72-8d0a-d19af08f4f3d req-afcb5c1b-abd7-472b-9871-054a00a51174 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "962b0526-5a3e-4044-a74f-34fe41f7717d", "tag": "d7edbb2e-2fa7-4065-ba3b-97a6d16d31e7"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:32:39.474018 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:32:39.474018 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:32:39.484726 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-22118808-4a96-4c72-8d0a-d19af08f4f3d req-afcb5c1b-abd7-472b-9871-054a00a51174 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:39.485152 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-22118808-4a96-4c72-8d0a-d19af08f4f3d req-afcb5c1b-abd7-472b-9871-054a00a51174 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:39.504346 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-22118808-4a96-4c72-8d0a-d19af08f4f3d req-afcb5c1b-abd7-472b-9871-054a00a51174 service nova] Creating event network-changed:d7edbb2e-2fa7-4065-ba3b-97a6d16d31e7 for instance 962b0526-5a3e-4044-a74f-34fe41f7717d on hv-cinder-81322 Feb 21 01:32:39.504944 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-22118808-4a96-4c72-8d0a-d19af08f4f3d req-afcb5c1b-abd7-472b-9871-054a00a51174 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123541) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 21 01:32:39.506052 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e77ebaff-2020-440e-852f-d3aed059389d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:39.506481 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e77ebaff-2020-440e-852f-d3aed059389d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:39.507538 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e77ebaff-2020-440e-852f-d3aed059389d None None] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:39.507957 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e77ebaff-2020-440e-852f-d3aed059389d None None] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:39.516685 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.compute.rpcapi [None req-e77ebaff-2020-440e-852f-d3aed059389d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 21 01:32:39.517579 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e77ebaff-2020-440e-852f-d3aed059389d None None] Releasing lock "compute-rpcapi-router" {{(pid=123541) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 21 01:32:39.534011 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e77ebaff-2020-440e-852f-d3aed059389d None None] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066035 Feb 21 01:32:39.534892 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 59/124] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:32:39.655184 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1077a2af-218f-4ca1-a855-9d047d918b5d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:39.655885 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1077a2af-218f-4ca1-a855-9d047d918b5d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:39.662931 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1077a2af-218f-4ca1-a855-9d047d918b5d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:39.663494 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1077a2af-218f-4ca1-a855-9d047d918b5d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:39.664367 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1077a2af-218f-4ca1-a855-9d047d918b5d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:39.664838 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1077a2af-218f-4ca1-a855-9d047d918b5d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:39.757051 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-8199dab8-36d4-4f42-9cb6-435ed1f5434f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:39.765203 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8199dab8-36d4-4f42-9cb6-435ed1f5434f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1322 microversion: 2.1 time: 0.398731 Feb 21 01:32:39.765772 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 66/125] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:39 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1322 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:39.826381 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8cc07c0a-735e-4b06-94c3-da6627fcaf71 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:39.827101 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8cc07c0a-735e-4b06-94c3-da6627fcaf71 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:39.832933 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cc07c0a-735e-4b06-94c3-da6627fcaf71 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:39.833465 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cc07c0a-735e-4b06-94c3-da6627fcaf71 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:39.834334 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cc07c0a-735e-4b06-94c3-da6627fcaf71 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:39.834841 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8cc07c0a-735e-4b06-94c3-da6627fcaf71 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:39.845412 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1077a2af-218f-4ca1-a855-9d047d918b5d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:39.853029 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1077a2af-218f-4ca1-a855-9d047d918b5d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.202600 Feb 21 01:32:39.853614 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 60/126] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:39 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:39.968388 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-8cc07c0a-735e-4b06-94c3-da6627fcaf71 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:39.976569 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-8cc07c0a-735e-4b06-94c3-da6627fcaf71 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:39.978061 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-8cc07c0a-735e-4b06-94c3-da6627fcaf71 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:39.979145 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8cc07c0a-735e-4b06-94c3-da6627fcaf71 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1406 microversion: 2.20 time: 0.157080 Feb 21 01:32:39.979693 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 67/127] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:39 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:32:40.157127 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-086e7653-1bb3-436f-8a51-6ae19987affc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:40.157738 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-086e7653-1bb3-436f-8a51-6ae19987affc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:40.163351 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-086e7653-1bb3-436f-8a51-6ae19987affc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:40.163801 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-086e7653-1bb3-436f-8a51-6ae19987affc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:40.164604 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-086e7653-1bb3-436f-8a51-6ae19987affc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:40.165042 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-086e7653-1bb3-436f-8a51-6ae19987affc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:40.304911 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-086e7653-1bb3-436f-8a51-6ae19987affc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:40.312823 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-086e7653-1bb3-436f-8a51-6ae19987affc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1362 microversion: 2.1 time: 0.159288 Feb 21 01:32:40.316862 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 61/128] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:40 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:40.375599 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9aa1666e-0681-4777-b771-7d330a325915 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:40.379208 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9aa1666e-0681-4777-b771-7d330a325915 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:40.382490 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9aa1666e-0681-4777-b771-7d330a325915 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:40.382934 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9aa1666e-0681-4777-b771-7d330a325915 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:40.383706 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9aa1666e-0681-4777-b771-7d330a325915 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:40.384133 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9aa1666e-0681-4777-b771-7d330a325915 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:40.549363 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-9aa1666e-0681-4777-b771-7d330a325915 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:40.556782 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9aa1666e-0681-4777-b771-7d330a325915 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.185477 Feb 21 01:32:40.557353 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 68/129] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:40 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:40.782586 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-caa8ccca-f2f0-4255-a241-fa3438087541 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:40.782586 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-caa8ccca-f2f0-4255-a241-fa3438087541 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:40.788800 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-caa8ccca-f2f0-4255-a241-fa3438087541 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:40.789247 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-caa8ccca-f2f0-4255-a241-fa3438087541 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:40.790023 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-caa8ccca-f2f0-4255-a241-fa3438087541 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:40.790446 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-caa8ccca-f2f0-4255-a241-fa3438087541 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:40.869727 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a8f49a27-f2f1-449b-8f3c-18efaf0a562d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:40.870307 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a8f49a27-f2f1-449b-8f3c-18efaf0a562d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:40.876243 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a8f49a27-f2f1-449b-8f3c-18efaf0a562d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:40.876712 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a8f49a27-f2f1-449b-8f3c-18efaf0a562d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:40.877472 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a8f49a27-f2f1-449b-8f3c-18efaf0a562d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:40.877894 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a8f49a27-f2f1-449b-8f3c-18efaf0a562d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:40.931039 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-caa8ccca-f2f0-4255-a241-fa3438087541 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:40.938264 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-caa8ccca-f2f0-4255-a241-fa3438087541 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1322 microversion: 2.1 time: 0.160073 Feb 21 01:32:40.939027 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 62/130] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:40 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:40.995867 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-30e8d2b5-e127-4936-a223-0eb0efeaa9dd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:40.998959 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-30e8d2b5-e127-4936-a223-0eb0efeaa9dd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:41.002329 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30e8d2b5-e127-4936-a223-0eb0efeaa9dd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:41.002781 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30e8d2b5-e127-4936-a223-0eb0efeaa9dd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:41.003551 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30e8d2b5-e127-4936-a223-0eb0efeaa9dd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:41.003984 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30e8d2b5-e127-4936-a223-0eb0efeaa9dd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:41.021567 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-a8f49a27-f2f1-449b-8f3c-18efaf0a562d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:41.029202 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a8f49a27-f2f1-449b-8f3c-18efaf0a562d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.163111 Feb 21 01:32:41.029771 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 69/131] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:40 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:41.186752 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-30e8d2b5-e127-4936-a223-0eb0efeaa9dd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:41.194501 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-30e8d2b5-e127-4936-a223-0eb0efeaa9dd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:41.195997 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-30e8d2b5-e127-4936-a223-0eb0efeaa9dd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:41.197116 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-30e8d2b5-e127-4936-a223-0eb0efeaa9dd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1406 microversion: 2.20 time: 0.205305 Feb 21 01:32:41.197675 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 63/132] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:40 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:32:41.329335 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d67b607a-b48f-495a-8be1-33137210e6c5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:41.329939 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d67b607a-b48f-495a-8be1-33137210e6c5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:41.335544 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d67b607a-b48f-495a-8be1-33137210e6c5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:41.336176 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d67b607a-b48f-495a-8be1-33137210e6c5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:41.336957 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d67b607a-b48f-495a-8be1-33137210e6c5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:41.337379 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d67b607a-b48f-495a-8be1-33137210e6c5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:41.469666 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-d67b607a-b48f-495a-8be1-33137210e6c5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:41.478468 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d67b607a-b48f-495a-8be1-33137210e6c5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1362 microversion: 2.1 time: 0.153105 Feb 21 01:32:41.479239 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 70/133] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:41 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:41.574627 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5d769186-086b-4b1b-8a90-32b96694f91d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:41.575808 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5d769186-086b-4b1b-8a90-32b96694f91d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:41.581553 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d769186-086b-4b1b-8a90-32b96694f91d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:41.582001 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d769186-086b-4b1b-8a90-32b96694f91d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:41.582773 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d769186-086b-4b1b-8a90-32b96694f91d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:41.583204 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d769186-086b-4b1b-8a90-32b96694f91d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:41.787343 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-5d769186-086b-4b1b-8a90-32b96694f91d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:41.789288 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5d769186-086b-4b1b-8a90-32b96694f91d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.218484 Feb 21 01:32:41.789907 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 64/134] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:41 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:41.954845 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cf3c7ca4-248d-43ed-a935-daea11610b7c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:41.955464 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cf3c7ca4-248d-43ed-a935-daea11610b7c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:41.961180 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf3c7ca4-248d-43ed-a935-daea11610b7c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:41.961635 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf3c7ca4-248d-43ed-a935-daea11610b7c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:41.962409 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf3c7ca4-248d-43ed-a935-daea11610b7c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:41.962839 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf3c7ca4-248d-43ed-a935-daea11610b7c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:42.046367 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-16df87cb-1be6-40f2-9151-d42a692c0766 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:42.046998 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-16df87cb-1be6-40f2-9151-d42a692c0766 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:42.052972 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16df87cb-1be6-40f2-9151-d42a692c0766 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:42.053426 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16df87cb-1be6-40f2-9151-d42a692c0766 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:42.054235 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16df87cb-1be6-40f2-9151-d42a692c0766 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:42.054665 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16df87cb-1be6-40f2-9151-d42a692c0766 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:42.101851 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-cf3c7ca4-248d-43ed-a935-daea11610b7c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:42.109847 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cf3c7ca4-248d-43ed-a935-daea11610b7c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1322 microversion: 2.1 time: 0.158794 Feb 21 01:32:42.110551 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 71/135] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:41 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:42.215020 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-90985da7-2045-4d3c-a7f0-229f221089f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:42.215823 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-90985da7-2045-4d3c-a7f0-229f221089f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:42.226961 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-16df87cb-1be6-40f2-9151-d42a692c0766 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:42.230656 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-90985da7-2045-4d3c-a7f0-229f221089f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:42.232221 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-90985da7-2045-4d3c-a7f0-229f221089f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:42.233659 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-90985da7-2045-4d3c-a7f0-229f221089f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:42.234446 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-90985da7-2045-4d3c-a7f0-229f221089f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:42.236315 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-16df87cb-1be6-40f2-9151-d42a692c0766 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.194177 Feb 21 01:32:42.237140 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 65/136] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:42 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:42.373737 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-90985da7-2045-4d3c-a7f0-229f221089f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:42.381920 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-90985da7-2045-4d3c-a7f0-229f221089f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:42.383794 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-90985da7-2045-4d3c-a7f0-229f221089f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:42.384940 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-90985da7-2045-4d3c-a7f0-229f221089f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1406 microversion: 2.20 time: 0.173753 Feb 21 01:32:42.385496 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 72/137] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:42 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:32:42.502814 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2572ff45-6545-411a-ac02-ea97b3f46ba0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:42.503432 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2572ff45-6545-411a-ac02-ea97b3f46ba0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:42.509901 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2572ff45-6545-411a-ac02-ea97b3f46ba0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:42.510348 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2572ff45-6545-411a-ac02-ea97b3f46ba0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:42.511117 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2572ff45-6545-411a-ac02-ea97b3f46ba0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:42.511547 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2572ff45-6545-411a-ac02-ea97b3f46ba0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:42.652369 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2572ff45-6545-411a-ac02-ea97b3f46ba0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:42.660353 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2572ff45-6545-411a-ac02-ea97b3f46ba0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1362 microversion: 2.1 time: 0.161172 Feb 21 01:32:42.660942 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 66/138] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:42 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:42.806258 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-20735c04-be51-41d6-9136-a7ee4efdfe10 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:42.806612 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-20735c04-be51-41d6-9136-a7ee4efdfe10 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:42.812275 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20735c04-be51-41d6-9136-a7ee4efdfe10 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:42.812728 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20735c04-be51-41d6-9136-a7ee4efdfe10 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:42.813522 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20735c04-be51-41d6-9136-a7ee4efdfe10 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:42.813957 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20735c04-be51-41d6-9136-a7ee4efdfe10 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:42.943694 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-20735c04-be51-41d6-9136-a7ee4efdfe10 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:42.951604 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-20735c04-be51-41d6-9136-a7ee4efdfe10 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.149394 Feb 21 01:32:42.952169 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 73/139] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:42 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:43.126882 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7a8dd48a-24df-4d48-a203-49d12d0cbd76 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:43.127566 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7a8dd48a-24df-4d48-a203-49d12d0cbd76 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:43.133554 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a8dd48a-24df-4d48-a203-49d12d0cbd76 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:43.134066 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a8dd48a-24df-4d48-a203-49d12d0cbd76 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:43.134892 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a8dd48a-24df-4d48-a203-49d12d0cbd76 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:43.135318 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a8dd48a-24df-4d48-a203-49d12d0cbd76 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:43.253040 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-03bdd56d-aa53-452d-b1c1-545192b75530 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:43.254225 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-03bdd56d-aa53-452d-b1c1-545192b75530 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:43.260513 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-03bdd56d-aa53-452d-b1c1-545192b75530 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:43.264124 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-03bdd56d-aa53-452d-b1c1-545192b75530 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:43.264124 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-03bdd56d-aa53-452d-b1c1-545192b75530 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:43.264124 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-03bdd56d-aa53-452d-b1c1-545192b75530 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:43.268325 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-7a8dd48a-24df-4d48-a203-49d12d0cbd76 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:43.276979 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7a8dd48a-24df-4d48-a203-49d12d0cbd76 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1322 microversion: 2.1 time: 0.153449 Feb 21 01:32:43.278537 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 67/140] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:43 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:43.394103 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-03bdd56d-aa53-452d-b1c1-545192b75530 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:43.401416 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-03bdd56d-aa53-452d-b1c1-545192b75530 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.152140 Feb 21 01:32:43.401981 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 74/141] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:43 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:43.402788 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bcb933f7-467e-402e-8c62-1aa7b42cc726 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:43.403954 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bcb933f7-467e-402e-8c62-1aa7b42cc726 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:43.410372 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bcb933f7-467e-402e-8c62-1aa7b42cc726 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:43.410818 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bcb933f7-467e-402e-8c62-1aa7b42cc726 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:43.411583 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bcb933f7-467e-402e-8c62-1aa7b42cc726 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:43.412007 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bcb933f7-467e-402e-8c62-1aa7b42cc726 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:43.544372 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-bcb933f7-467e-402e-8c62-1aa7b42cc726 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:43.552284 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-bcb933f7-467e-402e-8c62-1aa7b42cc726 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:43.553823 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-bcb933f7-467e-402e-8c62-1aa7b42cc726 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:43.554945 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bcb933f7-467e-402e-8c62-1aa7b42cc726 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1406 microversion: 2.20 time: 0.156209 Feb 21 01:32:43.555680 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 68/142] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:43 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:32:43.676760 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3521b207-67bf-4820-83ff-2050427f993a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:43.677448 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3521b207-67bf-4820-83ff-2050427f993a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:43.683446 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3521b207-67bf-4820-83ff-2050427f993a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:43.683893 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3521b207-67bf-4820-83ff-2050427f993a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:43.684774 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3521b207-67bf-4820-83ff-2050427f993a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:43.685205 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3521b207-67bf-4820-83ff-2050427f993a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:43.968190 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a794cbbe-1897-4937-9fd6-3acde5b49226 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:43.969171 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a794cbbe-1897-4937-9fd6-3acde5b49226 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:43.969317 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-3521b207-67bf-4820-83ff-2050427f993a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:43.975056 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a794cbbe-1897-4937-9fd6-3acde5b49226 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:43.975583 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a794cbbe-1897-4937-9fd6-3acde5b49226 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:43.976440 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a794cbbe-1897-4937-9fd6-3acde5b49226 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:43.976950 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a794cbbe-1897-4937-9fd6-3acde5b49226 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:43.978088 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3521b207-67bf-4820-83ff-2050427f993a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1362 microversion: 2.1 time: 0.304770 Feb 21 01:32:43.978887 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 75/143] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:43 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1362 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:44.116612 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-a794cbbe-1897-4937-9fd6-3acde5b49226 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:44.124280 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a794cbbe-1897-4937-9fd6-3acde5b49226 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.159817 Feb 21 01:32:44.124874 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 69/144] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:43 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:44.295040 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-eca57c13-fcb6-4c20-a450-ccd0d066e1e3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:44.295650 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-eca57c13-fcb6-4c20-a450-ccd0d066e1e3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:44.301416 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eca57c13-fcb6-4c20-a450-ccd0d066e1e3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:44.301862 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eca57c13-fcb6-4c20-a450-ccd0d066e1e3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:44.302630 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eca57c13-fcb6-4c20-a450-ccd0d066e1e3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:44.303057 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eca57c13-fcb6-4c20-a450-ccd0d066e1e3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:44.419797 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-29fa9425-4a39-4537-9cc9-b498b5fe0820 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:44.420502 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-29fa9425-4a39-4537-9cc9-b498b5fe0820 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:44.426160 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29fa9425-4a39-4537-9cc9-b498b5fe0820 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:44.426598 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29fa9425-4a39-4537-9cc9-b498b5fe0820 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:44.427371 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29fa9425-4a39-4537-9cc9-b498b5fe0820 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:44.427830 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-29fa9425-4a39-4537-9cc9-b498b5fe0820 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:44.441711 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-eca57c13-fcb6-4c20-a450-ccd0d066e1e3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:44.449128 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-eca57c13-fcb6-4c20-a450-ccd0d066e1e3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1322 microversion: 2.1 time: 0.158274 Feb 21 01:32:44.449902 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 76/145] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:44 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:44.562665 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-29fa9425-4a39-4537-9cc9-b498b5fe0820 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:44.569927 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-29fa9425-4a39-4537-9cc9-b498b5fe0820 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.155156 Feb 21 01:32:44.570489 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 70/146] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:44 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:44.571755 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4eb5006b-e0d2-4933-9395-7630ed9cf9e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:44.572387 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4eb5006b-e0d2-4933-9395-7630ed9cf9e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:44.578360 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4eb5006b-e0d2-4933-9395-7630ed9cf9e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:44.578837 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4eb5006b-e0d2-4933-9395-7630ed9cf9e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:44.579598 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4eb5006b-e0d2-4933-9395-7630ed9cf9e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:44.580053 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4eb5006b-e0d2-4933-9395-7630ed9cf9e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:44.730251 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-4eb5006b-e0d2-4933-9395-7630ed9cf9e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:44.739230 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-4eb5006b-e0d2-4933-9395-7630ed9cf9e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:44.741044 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-4eb5006b-e0d2-4933-9395-7630ed9cf9e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:44.744307 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4eb5006b-e0d2-4933-9395-7630ed9cf9e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1406 microversion: 2.20 time: 0.174399 Feb 21 01:32:44.744307 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 77/147] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:44 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:32:44.994210 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e60b3db5-5ed3-4d64-8b52-dc6b9d642820 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:44.994850 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e60b3db5-5ed3-4d64-8b52-dc6b9d642820 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:45.000752 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e60b3db5-5ed3-4d64-8b52-dc6b9d642820 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:45.005579 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e60b3db5-5ed3-4d64-8b52-dc6b9d642820 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:45.005579 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e60b3db5-5ed3-4d64-8b52-dc6b9d642820 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:45.005579 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e60b3db5-5ed3-4d64-8b52-dc6b9d642820 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:45.142899 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-309d1318-83de-4a6c-a302-2fa7e1f70931 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:45.147042 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-309d1318-83de-4a6c-a302-2fa7e1f70931 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:45.149674 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-309d1318-83de-4a6c-a302-2fa7e1f70931 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:45.151782 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-309d1318-83de-4a6c-a302-2fa7e1f70931 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:45.152766 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-309d1318-83de-4a6c-a302-2fa7e1f70931 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:45.154091 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-309d1318-83de-4a6c-a302-2fa7e1f70931 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:45.191617 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-e60b3db5-5ed3-4d64-8b52-dc6b9d642820 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:45.200865 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e60b3db5-5ed3-4d64-8b52-dc6b9d642820 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1362 microversion: 2.1 time: 0.210251 Feb 21 01:32:45.211315 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 71/148] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:44 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:45.312485 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-309d1318-83de-4a6c-a302-2fa7e1f70931 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:45.320769 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-309d1318-83de-4a6c-a302-2fa7e1f70931 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.183151 Feb 21 01:32:45.321389 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 78/149] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:45 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:45.465289 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-991dcfcf-4df9-41e6-b0c1-87cbb8484a3e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:45.466285 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-991dcfcf-4df9-41e6-b0c1-87cbb8484a3e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:45.472120 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-991dcfcf-4df9-41e6-b0c1-87cbb8484a3e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:45.476770 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-991dcfcf-4df9-41e6-b0c1-87cbb8484a3e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:45.476770 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-991dcfcf-4df9-41e6-b0c1-87cbb8484a3e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:45.476770 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-991dcfcf-4df9-41e6-b0c1-87cbb8484a3e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:45.586176 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c9128110-7379-4c81-9ac4-f10b5e03fc87 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:45.586906 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c9128110-7379-4c81-9ac4-f10b5e03fc87 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:45.592691 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9128110-7379-4c81-9ac4-f10b5e03fc87 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:45.593140 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9128110-7379-4c81-9ac4-f10b5e03fc87 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:45.593908 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9128110-7379-4c81-9ac4-f10b5e03fc87 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:45.594339 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9128110-7379-4c81-9ac4-f10b5e03fc87 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:45.694631 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-991dcfcf-4df9-41e6-b0c1-87cbb8484a3e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:45.703426 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-991dcfcf-4df9-41e6-b0c1-87cbb8484a3e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1322 microversion: 2.1 time: 0.241817 Feb 21 01:32:45.704056 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 72/150] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:45 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:45.760888 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7ef92b5e-68df-4178-9d88-c2be83931b50 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:45.761720 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7ef92b5e-68df-4178-9d88-c2be83931b50 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:45.768042 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ef92b5e-68df-4178-9d88-c2be83931b50 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:45.768521 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ef92b5e-68df-4178-9d88-c2be83931b50 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:45.769495 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ef92b5e-68df-4178-9d88-c2be83931b50 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:45.770094 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7ef92b5e-68df-4178-9d88-c2be83931b50 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:45.952584 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c9128110-7379-4c81-9ac4-f10b5e03fc87 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:45.960380 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c9128110-7379-4c81-9ac4-f10b5e03fc87 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.377824 Feb 21 01:32:45.961188 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 79/151] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:45 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:45.971601 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-7ef92b5e-68df-4178-9d88-c2be83931b50 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:45.979448 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-7ef92b5e-68df-4178-9d88-c2be83931b50 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:45.981521 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-7ef92b5e-68df-4178-9d88-c2be83931b50 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:45.983307 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7ef92b5e-68df-4178-9d88-c2be83931b50 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1406 microversion: 2.20 time: 0.226812 Feb 21 01:32:45.985090 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 73/152] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:45 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:32:46.219027 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e0fe5868-7974-41eb-b12e-6243ad4c8a97 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:46.219634 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e0fe5868-7974-41eb-b12e-6243ad4c8a97 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:46.225353 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0fe5868-7974-41eb-b12e-6243ad4c8a97 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:46.225802 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0fe5868-7974-41eb-b12e-6243ad4c8a97 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:46.226564 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0fe5868-7974-41eb-b12e-6243ad4c8a97 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:46.226991 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0fe5868-7974-41eb-b12e-6243ad4c8a97 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:46.338189 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4767bc64-3ee4-48d7-8f79-2164ff224530 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:46.338796 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4767bc64-3ee4-48d7-8f79-2164ff224530 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:46.345560 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4767bc64-3ee4-48d7-8f79-2164ff224530 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:46.346004 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4767bc64-3ee4-48d7-8f79-2164ff224530 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:46.346850 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4767bc64-3ee4-48d7-8f79-2164ff224530 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:46.347614 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4767bc64-3ee4-48d7-8f79-2164ff224530 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:46.382846 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-e0fe5868-7974-41eb-b12e-6243ad4c8a97 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:46.390623 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e0fe5868-7974-41eb-b12e-6243ad4c8a97 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1362 microversion: 2.1 time: 0.175773 Feb 21 01:32:46.391217 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 80/153] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:46 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:46.495329 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-4767bc64-3ee4-48d7-8f79-2164ff224530 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:46.503825 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4767bc64-3ee4-48d7-8f79-2164ff224530 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.169089 Feb 21 01:32:46.504772 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 74/154] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:46 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:46.720612 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0fe3aecb-9c93-481c-b46b-6c2399175d8a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:46.721263 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0fe3aecb-9c93-481c-b46b-6c2399175d8a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:46.727473 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0fe3aecb-9c93-481c-b46b-6c2399175d8a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:46.727925 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0fe3aecb-9c93-481c-b46b-6c2399175d8a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:46.728957 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0fe3aecb-9c93-481c-b46b-6c2399175d8a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:46.729614 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0fe3aecb-9c93-481c-b46b-6c2399175d8a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:46.897987 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-0fe3aecb-9c93-481c-b46b-6c2399175d8a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:46.906133 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0fe3aecb-9c93-481c-b46b-6c2399175d8a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1322 microversion: 2.1 time: 0.189420 Feb 21 01:32:46.906942 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 81/155] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:46 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:46.976372 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b73c2a88-982a-4bda-b36f-97da7ba5212c tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:46.977013 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b73c2a88-982a-4bda-b36f-97da7ba5212c tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:46.984649 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b73c2a88-982a-4bda-b36f-97da7ba5212c tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:46.985154 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b73c2a88-982a-4bda-b36f-97da7ba5212c tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:46.985948 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b73c2a88-982a-4bda-b36f-97da7ba5212c tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:46.986450 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b73c2a88-982a-4bda-b36f-97da7ba5212c tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:47.001455 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0481d2e7-18a7-4f43-8320-51448ad8f6ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:47.002192 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0481d2e7-18a7-4f43-8320-51448ad8f6ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:47.008959 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0481d2e7-18a7-4f43-8320-51448ad8f6ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:47.009653 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0481d2e7-18a7-4f43-8320-51448ad8f6ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:47.011066 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0481d2e7-18a7-4f43-8320-51448ad8f6ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:47.011500 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0481d2e7-18a7-4f43-8320-51448ad8f6ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:47.206797 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b73c2a88-982a-4bda-b36f-97da7ba5212c tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:47.211010 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-0481d2e7-18a7-4f43-8320-51448ad8f6ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:47.214179 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b73c2a88-982a-4bda-b36f-97da7ba5212c tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.241396 Feb 21 01:32:47.217402 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 75/156] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:46 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:47.221132 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-0481d2e7-18a7-4f43-8320-51448ad8f6ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:47.222786 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-0481d2e7-18a7-4f43-8320-51448ad8f6ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:47.223964 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0481d2e7-18a7-4f43-8320-51448ad8f6ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1406 microversion: 2.20 time: 0.226568 Feb 21 01:32:47.224612 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 82/157] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:46 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:32:47.407841 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d87cd618-26f4-4f07-bae7-eefe4bf460e6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:47.408665 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d87cd618-26f4-4f07-bae7-eefe4bf460e6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:47.414415 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d87cd618-26f4-4f07-bae7-eefe4bf460e6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:47.414866 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d87cd618-26f4-4f07-bae7-eefe4bf460e6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:47.415638 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d87cd618-26f4-4f07-bae7-eefe4bf460e6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:47.416068 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d87cd618-26f4-4f07-bae7-eefe4bf460e6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:47.521061 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-57fa7fb1-f4df-481c-8a78-7ded3fba0bab tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:47.522357 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-57fa7fb1-f4df-481c-8a78-7ded3fba0bab tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:47.528979 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57fa7fb1-f4df-481c-8a78-7ded3fba0bab tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:47.529636 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57fa7fb1-f4df-481c-8a78-7ded3fba0bab tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:47.530407 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57fa7fb1-f4df-481c-8a78-7ded3fba0bab tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:47.530843 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57fa7fb1-f4df-481c-8a78-7ded3fba0bab tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:47.553498 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-d87cd618-26f4-4f07-bae7-eefe4bf460e6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:47.563657 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d87cd618-26f4-4f07-bae7-eefe4bf460e6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1362 microversion: 2.1 time: 0.159625 Feb 21 01:32:47.564551 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 76/158] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:47 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:47.674668 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-57fa7fb1-f4df-481c-8a78-7ded3fba0bab tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:47.685037 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-57fa7fb1-f4df-481c-8a78-7ded3fba0bab tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.166912 Feb 21 01:32:47.685809 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 83/159] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:47 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:47.923140 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a50f9e88-cee5-4cc2-97a2-abe3b14013ac tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:47.923746 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a50f9e88-cee5-4cc2-97a2-abe3b14013ac tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:47.929576 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a50f9e88-cee5-4cc2-97a2-abe3b14013ac tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:47.930029 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a50f9e88-cee5-4cc2-97a2-abe3b14013ac tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:47.930812 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a50f9e88-cee5-4cc2-97a2-abe3b14013ac tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:47.931299 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a50f9e88-cee5-4cc2-97a2-abe3b14013ac tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:48.065506 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-a50f9e88-cee5-4cc2-97a2-abe3b14013ac tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:48.072935 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a50f9e88-cee5-4cc2-97a2-abe3b14013ac tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1322 microversion: 2.1 time: 0.153391 Feb 21 01:32:48.073508 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 77/160] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:47 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:48.239094 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-22bc95f6-3889-42cc-808d-d4dc50b1dc92 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:48.239094 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-22bc95f6-3889-42cc-808d-d4dc50b1dc92 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:48.239094 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22bc95f6-3889-42cc-808d-d4dc50b1dc92 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:48.239094 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22bc95f6-3889-42cc-808d-d4dc50b1dc92 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:48.240133 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22bc95f6-3889-42cc-808d-d4dc50b1dc92 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:48.240133 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22bc95f6-3889-42cc-808d-d4dc50b1dc92 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:48.241317 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3af75f16-121c-491b-9547-69c22b9f70fc tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:48.241930 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3af75f16-121c-491b-9547-69c22b9f70fc tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:48.248519 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3af75f16-121c-491b-9547-69c22b9f70fc tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:48.251508 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3af75f16-121c-491b-9547-69c22b9f70fc tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:48.251508 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3af75f16-121c-491b-9547-69c22b9f70fc tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:48.251508 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3af75f16-121c-491b-9547-69c22b9f70fc tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:48.452114 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-22bc95f6-3889-42cc-808d-d4dc50b1dc92 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:48.455238 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-3af75f16-121c-491b-9547-69c22b9f70fc tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:48.459603 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-22bc95f6-3889-42cc-808d-d4dc50b1dc92 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.232161 Feb 21 01:32:48.460269 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 84/161] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:48 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:48.463218 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-3af75f16-121c-491b-9547-69c22b9f70fc tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:48.464736 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-3af75f16-121c-491b-9547-69c22b9f70fc tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:48.466327 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3af75f16-121c-491b-9547-69c22b9f70fc tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1406 microversion: 2.20 time: 0.228987 Feb 21 01:32:48.466863 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 78/162] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:48 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:32:48.580928 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-19dcdd51-dc1a-48a5-bfe4-b2c408c6fb66 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:48.581493 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-19dcdd51-dc1a-48a5-bfe4-b2c408c6fb66 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:48.587231 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19dcdd51-dc1a-48a5-bfe4-b2c408c6fb66 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:48.587691 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19dcdd51-dc1a-48a5-bfe4-b2c408c6fb66 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:48.588478 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19dcdd51-dc1a-48a5-bfe4-b2c408c6fb66 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:48.588917 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19dcdd51-dc1a-48a5-bfe4-b2c408c6fb66 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:48.701613 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-82910420-d972-4fec-8f16-014ecc200651 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:48.702263 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-82910420-d972-4fec-8f16-014ecc200651 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:48.707960 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82910420-d972-4fec-8f16-014ecc200651 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:48.708402 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82910420-d972-4fec-8f16-014ecc200651 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:48.709195 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82910420-d972-4fec-8f16-014ecc200651 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:48.709618 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82910420-d972-4fec-8f16-014ecc200651 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:48.718933 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-19dcdd51-dc1a-48a5-bfe4-b2c408c6fb66 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:48.726144 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-19dcdd51-dc1a-48a5-bfe4-b2c408c6fb66 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1362 microversion: 2.1 time: 0.148956 Feb 21 01:32:48.726798 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 85/163] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:48 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:48.841536 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-82910420-d972-4fec-8f16-014ecc200651 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:48.848644 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-82910420-d972-4fec-8f16-014ecc200651 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.150646 Feb 21 01:32:48.849211 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 79/164] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:48 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:49.089141 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-885f2086-37b3-4523-9085-0718eb7bc160 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:49.089684 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-885f2086-37b3-4523-9085-0718eb7bc160 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:49.096101 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-885f2086-37b3-4523-9085-0718eb7bc160 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:49.096580 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-885f2086-37b3-4523-9085-0718eb7bc160 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:49.097356 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-885f2086-37b3-4523-9085-0718eb7bc160 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:49.097791 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-885f2086-37b3-4523-9085-0718eb7bc160 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:49.245674 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-885f2086-37b3-4523-9085-0718eb7bc160 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:49.253012 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-885f2086-37b3-4523-9085-0718eb7bc160 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1322 microversion: 2.1 time: 0.167680 Feb 21 01:32:49.253579 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 86/165] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:49 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:49.479542 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9646f8f2-2108-46ae-889e-b2b2aba6fc58 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:49.483306 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9646f8f2-2108-46ae-889e-b2b2aba6fc58 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:49.488174 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e13ad54b-1795-4eda-b302-f5c394c0ea72 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:49.488346 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9646f8f2-2108-46ae-889e-b2b2aba6fc58 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:49.488680 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9646f8f2-2108-46ae-889e-b2b2aba6fc58 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:49.488799 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e13ad54b-1795-4eda-b302-f5c394c0ea72 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:49.489466 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9646f8f2-2108-46ae-889e-b2b2aba6fc58 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:49.489924 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9646f8f2-2108-46ae-889e-b2b2aba6fc58 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:49.494783 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e13ad54b-1795-4eda-b302-f5c394c0ea72 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:49.495229 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e13ad54b-1795-4eda-b302-f5c394c0ea72 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:49.496006 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e13ad54b-1795-4eda-b302-f5c394c0ea72 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:49.496450 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e13ad54b-1795-4eda-b302-f5c394c0ea72 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:49.735687 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-9646f8f2-2108-46ae-889e-b2b2aba6fc58 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:49.739806 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-e13ad54b-1795-4eda-b302-f5c394c0ea72 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:49.743289 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9646f8f2-2108-46ae-889e-b2b2aba6fc58 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.270270 Feb 21 01:32:49.743870 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 80/166] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:49 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:49.747635 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-e13ad54b-1795-4eda-b302-f5c394c0ea72 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:49.748323 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-07ef5063-80a3-463a-9b82-031b93a751b6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:49.750255 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-07ef5063-80a3-463a-9b82-031b93a751b6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:49.750985 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-e13ad54b-1795-4eda-b302-f5c394c0ea72 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:49.750985 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e13ad54b-1795-4eda-b302-f5c394c0ea72 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1406 microversion: 2.20 time: 0.266009 Feb 21 01:32:49.754786 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 87/167] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:49 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:32:49.756181 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07ef5063-80a3-463a-9b82-031b93a751b6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:49.756655 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07ef5063-80a3-463a-9b82-031b93a751b6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:49.757762 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07ef5063-80a3-463a-9b82-031b93a751b6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:49.758337 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-07ef5063-80a3-463a-9b82-031b93a751b6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:49.865678 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a102f96a-f18c-4324-9ce4-fd4cf443fa88 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:49.866438 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a102f96a-f18c-4324-9ce4-fd4cf443fa88 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:49.872799 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a102f96a-f18c-4324-9ce4-fd4cf443fa88 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:49.873350 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a102f96a-f18c-4324-9ce4-fd4cf443fa88 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:49.874124 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a102f96a-f18c-4324-9ce4-fd4cf443fa88 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:49.874556 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a102f96a-f18c-4324-9ce4-fd4cf443fa88 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:49.890422 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-07ef5063-80a3-463a-9b82-031b93a751b6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:49.897461 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-07ef5063-80a3-463a-9b82-031b93a751b6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1362 microversion: 2.1 time: 0.152668 Feb 21 01:32:49.898020 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 81/168] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:49 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:50.005684 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-a102f96a-f18c-4324-9ce4-fd4cf443fa88 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:50.013585 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a102f96a-f18c-4324-9ce4-fd4cf443fa88 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.151526 Feb 21 01:32:50.014140 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 88/169] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:49 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:50.270008 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2f562eec-dbcc-4bd3-a357-ccbc73039e8b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:50.270636 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2f562eec-dbcc-4bd3-a357-ccbc73039e8b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:50.276277 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f562eec-dbcc-4bd3-a357-ccbc73039e8b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:50.276745 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f562eec-dbcc-4bd3-a357-ccbc73039e8b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:50.277498 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f562eec-dbcc-4bd3-a357-ccbc73039e8b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:50.277942 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f562eec-dbcc-4bd3-a357-ccbc73039e8b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:50.416966 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2f562eec-dbcc-4bd3-a357-ccbc73039e8b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:50.424737 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2f562eec-dbcc-4bd3-a357-ccbc73039e8b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1322 microversion: 2.1 time: 0.158240 Feb 21 01:32:50.425289 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 82/170] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:50 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:50.759888 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5c5f87ef-ac76-4cc3-b239-79b16732ac2d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:50.760515 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5c5f87ef-ac76-4cc3-b239-79b16732ac2d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:50.766330 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c5f87ef-ac76-4cc3-b239-79b16732ac2d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:50.766772 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c5f87ef-ac76-4cc3-b239-79b16732ac2d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:50.767530 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c5f87ef-ac76-4cc3-b239-79b16732ac2d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:50.767952 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c5f87ef-ac76-4cc3-b239-79b16732ac2d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:50.769005 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2dc9e0a6-6320-4924-a188-f556988f669b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:50.769613 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2dc9e0a6-6320-4924-a188-f556988f669b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:50.775323 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2dc9e0a6-6320-4924-a188-f556988f669b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:50.775762 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2dc9e0a6-6320-4924-a188-f556988f669b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:50.776553 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2dc9e0a6-6320-4924-a188-f556988f669b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:50.776984 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2dc9e0a6-6320-4924-a188-f556988f669b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:50.972612 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-5c5f87ef-ac76-4cc3-b239-79b16732ac2d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:50.976508 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2dc9e0a6-6320-4924-a188-f556988f669b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:50.980733 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5c5f87ef-ac76-4cc3-b239-79b16732ac2d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.224681 Feb 21 01:32:50.981404 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 89/171] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:50 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:50.984416 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2dc9e0a6-6320-4924-a188-f556988f669b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:50.985940 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2dc9e0a6-6320-4924-a188-f556988f669b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:50.986589 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-46ae7b38-a823-4b11-8af7-09e7ea09c09d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:50.987033 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2dc9e0a6-6320-4924-a188-f556988f669b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1406 microversion: 2.20 time: 0.221659 Feb 21 01:32:50.987330 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-46ae7b38-a823-4b11-8af7-09e7ea09c09d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:50.987718 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 83/172] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:50 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:32:50.993097 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46ae7b38-a823-4b11-8af7-09e7ea09c09d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:50.993548 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46ae7b38-a823-4b11-8af7-09e7ea09c09d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:50.994322 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46ae7b38-a823-4b11-8af7-09e7ea09c09d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:50.994757 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46ae7b38-a823-4b11-8af7-09e7ea09c09d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:51.030598 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0ca4b33a-0427-4831-8e81-55e936c47136 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:51.031223 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0ca4b33a-0427-4831-8e81-55e936c47136 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:51.037029 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ca4b33a-0427-4831-8e81-55e936c47136 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:51.037465 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ca4b33a-0427-4831-8e81-55e936c47136 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:51.038222 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ca4b33a-0427-4831-8e81-55e936c47136 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:51.038643 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ca4b33a-0427-4831-8e81-55e936c47136 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:51.352330 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-46ae7b38-a823-4b11-8af7-09e7ea09c09d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:51.359981 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-46ae7b38-a823-4b11-8af7-09e7ea09c09d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1362 microversion: 2.1 time: 0.376885 Feb 21 01:32:51.360666 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 90/173] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:50 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1362 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:51.395922 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-0ca4b33a-0427-4831-8e81-55e936c47136 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:51.403459 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0ca4b33a-0427-4831-8e81-55e936c47136 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.377119 Feb 21 01:32:51.404017 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 84/174] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:51 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:51.440870 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1124e532-5d0b-4365-90d1-f395c1b6eaf0 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:51.441471 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1124e532-5d0b-4365-90d1-f395c1b6eaf0 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:51.447159 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1124e532-5d0b-4365-90d1-f395c1b6eaf0 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:51.447600 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1124e532-5d0b-4365-90d1-f395c1b6eaf0 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:51.448355 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1124e532-5d0b-4365-90d1-f395c1b6eaf0 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:51.448804 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1124e532-5d0b-4365-90d1-f395c1b6eaf0 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:51.579279 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-1124e532-5d0b-4365-90d1-f395c1b6eaf0 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:51.590411 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1124e532-5d0b-4365-90d1-f395c1b6eaf0 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1322 microversion: 2.1 time: 0.153096 Feb 21 01:32:51.591017 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 91/175] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:51 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:51.996951 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f4da5666-0561-4bc2-99b5-806914698225 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:51.997552 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f4da5666-0561-4bc2-99b5-806914698225 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:52.003362 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f4da5666-0561-4bc2-99b5-806914698225 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:52.003799 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f4da5666-0561-4bc2-99b5-806914698225 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:52.004176 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ce8a110b-bbcb-45bc-93ac-0741d58dfee2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:52.004603 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f4da5666-0561-4bc2-99b5-806914698225 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:52.004832 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ce8a110b-bbcb-45bc-93ac-0741d58dfee2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:52.004987 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f4da5666-0561-4bc2-99b5-806914698225 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:52.010791 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ce8a110b-bbcb-45bc-93ac-0741d58dfee2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:52.011231 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ce8a110b-bbcb-45bc-93ac-0741d58dfee2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:52.012507 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ce8a110b-bbcb-45bc-93ac-0741d58dfee2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:52.012949 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ce8a110b-bbcb-45bc-93ac-0741d58dfee2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:52.193224 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-f4da5666-0561-4bc2-99b5-806914698225 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:52.200940 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f4da5666-0561-4bc2-99b5-806914698225 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.207562 Feb 21 01:32:52.201820 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 85/176] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:51 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:52.204190 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ce8a110b-bbcb-45bc-93ac-0741d58dfee2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:52.212108 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ce8a110b-bbcb-45bc-93ac-0741d58dfee2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:52.213752 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ce8a110b-bbcb-45bc-93ac-0741d58dfee2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:52.214837 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ce8a110b-bbcb-45bc-93ac-0741d58dfee2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1406 microversion: 2.20 time: 0.214292 Feb 21 01:32:52.215411 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 92/177] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:51 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:32:52.376778 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bee30412-8ef8-457e-91c2-1a4d4df7a165 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:52.377405 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bee30412-8ef8-457e-91c2-1a4d4df7a165 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:52.383295 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bee30412-8ef8-457e-91c2-1a4d4df7a165 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:52.383734 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bee30412-8ef8-457e-91c2-1a4d4df7a165 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:52.384515 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bee30412-8ef8-457e-91c2-1a4d4df7a165 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:52.384939 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bee30412-8ef8-457e-91c2-1a4d4df7a165 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:52.420719 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9ce3fdd1-25eb-4b0a-95ed-3aa4db1903a3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:52.421325 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9ce3fdd1-25eb-4b0a-95ed-3aa4db1903a3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:52.427063 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ce3fdd1-25eb-4b0a-95ed-3aa4db1903a3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:52.427508 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ce3fdd1-25eb-4b0a-95ed-3aa4db1903a3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:52.428277 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ce3fdd1-25eb-4b0a-95ed-3aa4db1903a3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:52.428725 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ce3fdd1-25eb-4b0a-95ed-3aa4db1903a3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:52.587522 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-bee30412-8ef8-457e-91c2-1a4d4df7a165 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:52.594663 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bee30412-8ef8-457e-91c2-1a4d4df7a165 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1362 microversion: 2.1 time: 0.221464 Feb 21 01:32:52.595240 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 86/178] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:52 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:52.609365 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f867f3c4-1e64-4ee5-a578-51e98ab9487d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:52.609969 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f867f3c4-1e64-4ee5-a578-51e98ab9487d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:52.617758 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-9ce3fdd1-25eb-4b0a-95ed-3aa4db1903a3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:52.622563 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f867f3c4-1e64-4ee5-a578-51e98ab9487d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:52.623011 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f867f3c4-1e64-4ee5-a578-51e98ab9487d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:52.623797 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f867f3c4-1e64-4ee5-a578-51e98ab9487d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:52.624227 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f867f3c4-1e64-4ee5-a578-51e98ab9487d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:52.626278 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9ce3fdd1-25eb-4b0a-95ed-3aa4db1903a3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.209760 Feb 21 01:32:52.626929 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 93/179] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:52 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:52.756232 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-f867f3c4-1e64-4ee5-a578-51e98ab9487d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:52.763828 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f867f3c4-1e64-4ee5-a578-51e98ab9487d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1322 microversion: 2.1 time: 0.158442 Feb 21 01:32:52.764544 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 87/180] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:52 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:53.217502 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-faa0dd69-51c4-4af8-9cef-d6d4e0a751ff tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:53.218640 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-faa0dd69-51c4-4af8-9cef-d6d4e0a751ff tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:53.225838 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-faa0dd69-51c4-4af8-9cef-d6d4e0a751ff tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:53.226278 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-faa0dd69-51c4-4af8-9cef-d6d4e0a751ff tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:53.227257 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-faa0dd69-51c4-4af8-9cef-d6d4e0a751ff tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:53.227888 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-faa0dd69-51c4-4af8-9cef-d6d4e0a751ff tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:53.232227 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f85610cd-4af3-4cc9-bc30-60dab63c843f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:53.232873 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f85610cd-4af3-4cc9-bc30-60dab63c843f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:53.240290 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f85610cd-4af3-4cc9-bc30-60dab63c843f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:53.240811 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f85610cd-4af3-4cc9-bc30-60dab63c843f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:53.241648 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f85610cd-4af3-4cc9-bc30-60dab63c843f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:53.242447 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f85610cd-4af3-4cc9-bc30-60dab63c843f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:53.444349 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-faa0dd69-51c4-4af8-9cef-d6d4e0a751ff tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:53.447621 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-f85610cd-4af3-4cc9-bc30-60dab63c843f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:53.451779 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-faa0dd69-51c4-4af8-9cef-d6d4e0a751ff tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.238014 Feb 21 01:32:53.452350 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 94/181] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:53 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:53.455629 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-f85610cd-4af3-4cc9-bc30-60dab63c843f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:53.457146 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-f85610cd-4af3-4cc9-bc30-60dab63c843f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:53.458222 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f85610cd-4af3-4cc9-bc30-60dab63c843f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1406 microversion: 2.20 time: 0.230242 Feb 21 01:32:53.458749 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 88/182] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:53 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:32:53.612076 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f8033aef-4653-48e3-bc2b-834c0b4f6b87 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:53.612885 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f8033aef-4653-48e3-bc2b-834c0b4f6b87 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:53.621733 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8033aef-4653-48e3-bc2b-834c0b4f6b87 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:53.621733 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8033aef-4653-48e3-bc2b-834c0b4f6b87 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:53.621733 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8033aef-4653-48e3-bc2b-834c0b4f6b87 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:53.621733 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f8033aef-4653-48e3-bc2b-834c0b4f6b87 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:53.643729 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a898a61b-b4bb-423a-8d0e-898b9fa1f6f6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:53.644470 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a898a61b-b4bb-423a-8d0e-898b9fa1f6f6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:53.650295 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a898a61b-b4bb-423a-8d0e-898b9fa1f6f6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:53.650782 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a898a61b-b4bb-423a-8d0e-898b9fa1f6f6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:53.651557 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a898a61b-b4bb-423a-8d0e-898b9fa1f6f6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:53.651980 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a898a61b-b4bb-423a-8d0e-898b9fa1f6f6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:53.826332 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-f8033aef-4653-48e3-bc2b-834c0b4f6b87 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:53.832922 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-a898a61b-b4bb-423a-8d0e-898b9fa1f6f6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:53.841121 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f8033aef-4653-48e3-bc2b-834c0b4f6b87 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1362 microversion: 2.1 time: 0.232702 Feb 21 01:32:53.841848 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 95/183] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:53 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:53.841971 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a898a61b-b4bb-423a-8d0e-898b9fa1f6f6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.202178 Feb 21 01:32:53.842600 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 89/184] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:53 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:53.854775 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-57e8c888-1006-4b1e-8846-08ad2390e9b8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:53.855517 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-57e8c888-1006-4b1e-8846-08ad2390e9b8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:53.862562 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57e8c888-1006-4b1e-8846-08ad2390e9b8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:53.862935 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57e8c888-1006-4b1e-8846-08ad2390e9b8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:53.863715 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57e8c888-1006-4b1e-8846-08ad2390e9b8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:53.864145 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57e8c888-1006-4b1e-8846-08ad2390e9b8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:54.005334 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-57e8c888-1006-4b1e-8846-08ad2390e9b8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:54.014198 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-57e8c888-1006-4b1e-8846-08ad2390e9b8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1322 microversion: 2.1 time: 0.164348 Feb 21 01:32:54.014836 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 96/185] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:53 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:54.469059 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7b8c4290-56ab-4087-8808-fbafbe881e7c tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:54.470051 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7b8c4290-56ab-4087-8808-fbafbe881e7c tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:54.474701 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-eb09db76-d19e-48d2-9044-3f57bb3b8098 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:54.475356 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-eb09db76-d19e-48d2-9044-3f57bb3b8098 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:54.475869 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b8c4290-56ab-4087-8808-fbafbe881e7c tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:54.476311 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b8c4290-56ab-4087-8808-fbafbe881e7c tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:54.477115 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b8c4290-56ab-4087-8808-fbafbe881e7c tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:54.477544 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b8c4290-56ab-4087-8808-fbafbe881e7c tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:54.481787 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb09db76-d19e-48d2-9044-3f57bb3b8098 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:54.485096 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb09db76-d19e-48d2-9044-3f57bb3b8098 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:54.485096 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb09db76-d19e-48d2-9044-3f57bb3b8098 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:54.485096 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eb09db76-d19e-48d2-9044-3f57bb3b8098 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:54.690463 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-7b8c4290-56ab-4087-8808-fbafbe881e7c tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:54.700531 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-eb09db76-d19e-48d2-9044-3f57bb3b8098 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:54.708671 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-eb09db76-d19e-48d2-9044-3f57bb3b8098 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:54.709348 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7b8c4290-56ab-4087-8808-fbafbe881e7c tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.244299 Feb 21 01:32:54.709979 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 90/186] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:54 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:54.711540 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-eb09db76-d19e-48d2-9044-3f57bb3b8098 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:54.712728 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-eb09db76-d19e-48d2-9044-3f57bb3b8098 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1406 microversion: 2.20 time: 0.241681 Feb 21 01:32:54.713279 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 97/187] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:54 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:32:54.858442 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dc1d5d0c-5f9e-4db5-bde2-99a001ee83e0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:54.858677 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8387c0e7-cea1-4e72-97f2-b80167ca1631 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:54.859062 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8387c0e7-cea1-4e72-97f2-b80167ca1631 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:54.859423 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-dc1d5d0c-5f9e-4db5-bde2-99a001ee83e0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:54.866074 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8387c0e7-cea1-4e72-97f2-b80167ca1631 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:54.866202 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8387c0e7-cea1-4e72-97f2-b80167ca1631 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:54.866928 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8387c0e7-cea1-4e72-97f2-b80167ca1631 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:54.867359 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8387c0e7-cea1-4e72-97f2-b80167ca1631 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:54.867905 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc1d5d0c-5f9e-4db5-bde2-99a001ee83e0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:54.868450 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc1d5d0c-5f9e-4db5-bde2-99a001ee83e0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:54.869421 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc1d5d0c-5f9e-4db5-bde2-99a001ee83e0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:54.870005 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-dc1d5d0c-5f9e-4db5-bde2-99a001ee83e0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:55.077411 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-dc1d5d0c-5f9e-4db5-bde2-99a001ee83e0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:55.086675 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dc1d5d0c-5f9e-4db5-bde2-99a001ee83e0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1362 microversion: 2.1 time: 0.231357 Feb 21 01:32:55.086675 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 91/188] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:54 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:55.087028 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-8387c0e7-cea1-4e72-97f2-b80167ca1631 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:55.090483 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c3943468-bbe8-4805-82c6-794cd7e38164 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:55.094523 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c3943468-bbe8-4805-82c6-794cd7e38164 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:55.100837 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3943468-bbe8-4805-82c6-794cd7e38164 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:55.101469 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3943468-bbe8-4805-82c6-794cd7e38164 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:55.102244 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3943468-bbe8-4805-82c6-794cd7e38164 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:55.102673 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3943468-bbe8-4805-82c6-794cd7e38164 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:55.107647 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8387c0e7-cea1-4e72-97f2-b80167ca1631 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.252738 Feb 21 01:32:55.109926 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 98/189] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:54 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:55.271645 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-c3943468-bbe8-4805-82c6-794cd7e38164 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:55.279313 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c3943468-bbe8-4805-82c6-794cd7e38164 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1322 microversion: 2.1 time: 0.192541 Feb 21 01:32:55.279876 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 92/190] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:55 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:55.412626 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-0cba26fc-9086-4722-8dd3-2c412e36b6fb req-303d1283-d3a5-47ac-9af0-b9dd4833e0b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d88f85-1d15-4f12-a8e7-f3b531088d5e", "name": "network-vif-plugged", "status": "completed", "tag": "8dcff3a2-5327-4c3f-9f70-590bf220865d"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:32:55.414350 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:32:55.414350 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:32:55.424093 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-0cba26fc-9086-4722-8dd3-2c412e36b6fb req-303d1283-d3a5-47ac-9af0-b9dd4833e0b5 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:55.424559 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-0cba26fc-9086-4722-8dd3-2c412e36b6fb req-303d1283-d3a5-47ac-9af0-b9dd4833e0b5 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:55.436092 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-0cba26fc-9086-4722-8dd3-2c412e36b6fb req-303d1283-d3a5-47ac-9af0-b9dd4833e0b5 service nova] Creating event network-vif-plugged:8dcff3a2-5327-4c3f-9f70-590bf220865d for instance 58d88f85-1d15-4f12-a8e7-f3b531088d5e on hv-cinder-81322 Feb 21 01:32:55.440988 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-0cba26fc-9086-4722-8dd3-2c412e36b6fb req-303d1283-d3a5-47ac-9af0-b9dd4833e0b5 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095915 Feb 21 01:32:55.444408 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 99/191] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:32:55.725941 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-246fcc64-7eae-4e51-93de-5b6cf3a2333f tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:55.726798 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-246fcc64-7eae-4e51-93de-5b6cf3a2333f tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:55.733027 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2b34186e-15ca-4179-b097-e5b98dcc0097 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:55.736792 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2b34186e-15ca-4179-b097-e5b98dcc0097 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:55.736920 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-246fcc64-7eae-4e51-93de-5b6cf3a2333f tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:55.737397 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-246fcc64-7eae-4e51-93de-5b6cf3a2333f tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:55.738341 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-246fcc64-7eae-4e51-93de-5b6cf3a2333f tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:55.741411 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-246fcc64-7eae-4e51-93de-5b6cf3a2333f tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:55.741923 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b34186e-15ca-4179-b097-e5b98dcc0097 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:55.742556 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b34186e-15ca-4179-b097-e5b98dcc0097 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:55.743674 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b34186e-15ca-4179-b097-e5b98dcc0097 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:55.744625 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b34186e-15ca-4179-b097-e5b98dcc0097 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:56.078018 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-246fcc64-7eae-4e51-93de-5b6cf3a2333f tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:56.092530 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-2b34186e-15ca-4179-b097-e5b98dcc0097 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:56.097296 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-246fcc64-7eae-4e51-93de-5b6cf3a2333f tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.374738 Feb 21 01:32:56.101901 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 93/192] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:55 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:56.104277 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c12253ff-7a55-4b6d-8fb9-a655a77d6e77 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:56.104935 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c12253ff-7a55-4b6d-8fb9-a655a77d6e77 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:56.110822 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-2b34186e-15ca-4179-b097-e5b98dcc0097 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:56.112786 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-2b34186e-15ca-4179-b097-e5b98dcc0097 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:56.115128 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2b34186e-15ca-4179-b097-e5b98dcc0097 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1406 microversion: 2.20 time: 0.386645 Feb 21 01:32:56.115966 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 100/193] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:55 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1406 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:32:56.117034 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c12253ff-7a55-4b6d-8fb9-a655a77d6e77 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:56.118062 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c12253ff-7a55-4b6d-8fb9-a655a77d6e77 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:56.119051 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c12253ff-7a55-4b6d-8fb9-a655a77d6e77 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:56.119562 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c12253ff-7a55-4b6d-8fb9-a655a77d6e77 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:56.129527 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-83c13f3d-1476-4314-8198-9529bb8c5fe2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:56.130902 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-83c13f3d-1476-4314-8198-9529bb8c5fe2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:56.139478 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-83c13f3d-1476-4314-8198-9529bb8c5fe2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:56.140231 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-83c13f3d-1476-4314-8198-9529bb8c5fe2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:56.142389 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-83c13f3d-1476-4314-8198-9529bb8c5fe2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:56.143007 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-83c13f3d-1476-4314-8198-9529bb8c5fe2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:56.438007 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-c12253ff-7a55-4b6d-8fb9-a655a77d6e77 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:56.441081 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-83c13f3d-1476-4314-8198-9529bb8c5fe2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:56.445516 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c12253ff-7a55-4b6d-8fb9-a655a77d6e77 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1362 microversion: 2.1 time: 0.345764 Feb 21 01:32:56.446397 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 94/194] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:56 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1362 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:56.448830 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-83c13f3d-1476-4314-8198-9529bb8c5fe2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.326388 Feb 21 01:32:56.451215 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 101/195] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:56 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:56.451555 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-63d8ed5f-053a-4d36-a220-403965949fa3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:56.452148 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-63d8ed5f-053a-4d36-a220-403965949fa3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:56.459200 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63d8ed5f-053a-4d36-a220-403965949fa3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:56.459639 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63d8ed5f-053a-4d36-a220-403965949fa3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:56.460399 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63d8ed5f-053a-4d36-a220-403965949fa3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:56.460854 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63d8ed5f-053a-4d36-a220-403965949fa3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:56.604810 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-63d8ed5f-053a-4d36-a220-403965949fa3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:56.612935 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-63d8ed5f-053a-4d36-a220-403965949fa3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1322 microversion: 2.1 time: 0.165550 Feb 21 01:32:56.613507 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 95/196] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:56 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:57.117296 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5a67f78e-850b-49d2-bc7f-1f1cef6c7145 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:57.117857 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5a67f78e-850b-49d2-bc7f-1f1cef6c7145 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:57.123733 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a67f78e-850b-49d2-bc7f-1f1cef6c7145 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:57.124180 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a67f78e-850b-49d2-bc7f-1f1cef6c7145 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:57.124998 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a67f78e-850b-49d2-bc7f-1f1cef6c7145 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:57.125423 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a67f78e-850b-49d2-bc7f-1f1cef6c7145 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:57.132086 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-82ec1ec5-6dd6-42e0-856d-1c3d5a84950c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:57.132983 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-82ec1ec5-6dd6-42e0-856d-1c3d5a84950c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:57.139143 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82ec1ec5-6dd6-42e0-856d-1c3d5a84950c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:57.139592 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82ec1ec5-6dd6-42e0-856d-1c3d5a84950c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:57.140390 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82ec1ec5-6dd6-42e0-856d-1c3d5a84950c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:57.140821 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82ec1ec5-6dd6-42e0-856d-1c3d5a84950c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:57.336730 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-5a67f78e-850b-49d2-bc7f-1f1cef6c7145 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:57.344182 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5a67f78e-850b-49d2-bc7f-1f1cef6c7145 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.230507 Feb 21 01:32:57.344802 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 102/197] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:57 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:57.348059 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-82ec1ec5-6dd6-42e0-856d-1c3d5a84950c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:57.355804 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-82ec1ec5-6dd6-42e0-856d-1c3d5a84950c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:57.357402 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-82ec1ec5-6dd6-42e0-856d-1c3d5a84950c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:57.358574 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-82ec1ec5-6dd6-42e0-856d-1c3d5a84950c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1406 microversion: 2.20 time: 0.230221 Feb 21 01:32:57.359205 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 96/198] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:57 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:32:57.455752 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-974d1c7c-fc7c-4718-b397-62c24b321e3b req-1ce07c08-4ffc-486b-ae15-97c5b5bcfe5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5323990-b38c-44dd-812e-e5b7b3fd1ea9", "name": "network-vif-plugged", "status": "completed", "tag": "cf21197e-c8ae-4d32-9844-138c1e440316"}, {"server_uuid": "d359b725-8ebc-4c70-b60b-fac888f539dc", "name": "network-vif-plugged", "status": "completed", "tag": "29ef37bc-fe8f-48e8-8a21-00801ca04b5a"}, {"server_uuid": "ff526a32-96c9-4481-a88c-a0913652acfd", "name": "network-vif-plugged", "status": "completed", "tag": "fe876a1a-56e9-4821-ac6c-94fe28a1852e"}, {"server_uuid": "34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8", "name": "network-vif-plugged", "status": "completed", "tag": "4f6f4bf6-c2bb-4409-855b-387ebc13aa76"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:32:57.457805 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:32:57.457805 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:32:57.462046 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-703ca972-6587-48fc-accb-eeb70efe9642 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:57.462652 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-703ca972-6587-48fc-accb-eeb70efe9642 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:57.466926 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-974d1c7c-fc7c-4718-b397-62c24b321e3b req-1ce07c08-4ffc-486b-ae15-97c5b5bcfe5e service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:57.471300 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-974d1c7c-fc7c-4718-b397-62c24b321e3b req-1ce07c08-4ffc-486b-ae15-97c5b5bcfe5e service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:57.471410 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-703ca972-6587-48fc-accb-eeb70efe9642 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:57.471410 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-703ca972-6587-48fc-accb-eeb70efe9642 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:57.471410 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-703ca972-6587-48fc-accb-eeb70efe9642 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:57.471410 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-703ca972-6587-48fc-accb-eeb70efe9642 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:57.483180 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-974d1c7c-fc7c-4718-b397-62c24b321e3b req-1ce07c08-4ffc-486b-ae15-97c5b5bcfe5e service nova] Creating event network-vif-plugged:cf21197e-c8ae-4d32-9844-138c1e440316 for instance c5323990-b38c-44dd-812e-e5b7b3fd1ea9 on hv-cinder-81322 Feb 21 01:32:57.483819 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-974d1c7c-fc7c-4718-b397-62c24b321e3b req-1ce07c08-4ffc-486b-ae15-97c5b5bcfe5e service nova] Creating event network-vif-plugged:29ef37bc-fe8f-48e8-8a21-00801ca04b5a for instance d359b725-8ebc-4c70-b60b-fac888f539dc on hv-cinder-81322 Feb 21 01:32:57.484390 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-974d1c7c-fc7c-4718-b397-62c24b321e3b req-1ce07c08-4ffc-486b-ae15-97c5b5bcfe5e service nova] Creating event network-vif-plugged:fe876a1a-56e9-4821-ac6c-94fe28a1852e for instance ff526a32-96c9-4481-a88c-a0913652acfd on hv-cinder-81322 Feb 21 01:32:57.484971 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-974d1c7c-fc7c-4718-b397-62c24b321e3b req-1ce07c08-4ffc-486b-ae15-97c5b5bcfe5e service nova] Creating event network-vif-plugged:4f6f4bf6-c2bb-4409-855b-387ebc13aa76 for instance 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 on hv-cinder-81322 Feb 21 01:32:57.494619 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-974d1c7c-fc7c-4718-b397-62c24b321e3b req-1ce07c08-4ffc-486b-ae15-97c5b5bcfe5e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.042438 Feb 21 01:32:57.500279 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 103/199] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:32:57.502887 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c22af4b7-1aba-4458-a0d3-c3af27b385e5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:57.502887 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c22af4b7-1aba-4458-a0d3-c3af27b385e5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:57.509270 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c22af4b7-1aba-4458-a0d3-c3af27b385e5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:57.509804 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c22af4b7-1aba-4458-a0d3-c3af27b385e5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:57.510653 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c22af4b7-1aba-4458-a0d3-c3af27b385e5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:57.511151 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c22af4b7-1aba-4458-a0d3-c3af27b385e5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:57.805733 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-703ca972-6587-48fc-accb-eeb70efe9642 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:57.823091 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-703ca972-6587-48fc-accb-eeb70efe9642 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1362 microversion: 2.1 time: 0.364545 Feb 21 01:32:57.826545 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 97/200] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:57 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1362 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:57.842506 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-28e5f851-870b-4246-a144-0e5f4e77d984 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:57.843397 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-28e5f851-870b-4246-a144-0e5f4e77d984 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:57.844502 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c22af4b7-1aba-4458-a0d3-c3af27b385e5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:57.853524 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c22af4b7-1aba-4458-a0d3-c3af27b385e5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.356599 Feb 21 01:32:57.854112 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 104/201] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:57 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:57.856357 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28e5f851-870b-4246-a144-0e5f4e77d984 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:57.856755 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28e5f851-870b-4246-a144-0e5f4e77d984 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:57.858111 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28e5f851-870b-4246-a144-0e5f4e77d984 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:57.863012 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28e5f851-870b-4246-a144-0e5f4e77d984 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:58.090404 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-28e5f851-870b-4246-a144-0e5f4e77d984 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:58.098200 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-28e5f851-870b-4246-a144-0e5f4e77d984 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1322 microversion: 2.1 time: 0.271472 Feb 21 01:32:58.098825 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 98/202] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:57 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:58.361094 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d079d88b-2932-4eb0-8634-9032f7bb7380 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:58.361702 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d079d88b-2932-4eb0-8634-9032f7bb7380 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:58.367490 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d079d88b-2932-4eb0-8634-9032f7bb7380 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:58.367933 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d079d88b-2932-4eb0-8634-9032f7bb7380 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:58.368827 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d079d88b-2932-4eb0-8634-9032f7bb7380 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:58.369207 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d079d88b-2932-4eb0-8634-9032f7bb7380 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:58.377201 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e649e7f8-9fe8-4d4c-be60-770832aee182 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:58.378721 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e649e7f8-9fe8-4d4c-be60-770832aee182 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:58.386815 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e649e7f8-9fe8-4d4c-be60-770832aee182 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:58.387668 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e649e7f8-9fe8-4d4c-be60-770832aee182 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:58.389763 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e649e7f8-9fe8-4d4c-be60-770832aee182 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:58.390904 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e649e7f8-9fe8-4d4c-be60-770832aee182 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:58.627896 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-d079d88b-2932-4eb0-8634-9032f7bb7380 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:58.631450 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-e649e7f8-9fe8-4d4c-be60-770832aee182 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:58.636125 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d079d88b-2932-4eb0-8634-9032f7bb7380 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.279207 Feb 21 01:32:58.636734 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 105/203] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:58 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:58.640521 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-e649e7f8-9fe8-4d4c-be60-770832aee182 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:58.642021 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-e649e7f8-9fe8-4d4c-be60-770832aee182 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:58.643116 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e649e7f8-9fe8-4d4c-be60-770832aee182 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1406 microversion: 2.20 time: 0.270035 Feb 21 01:32:58.643663 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 99/204] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:58 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:32:58.842038 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9daf0df0-dd5e-4742-a007-9138f3fc7fa0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:58.842703 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9daf0df0-dd5e-4742-a007-9138f3fc7fa0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:58.848520 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9daf0df0-dd5e-4742-a007-9138f3fc7fa0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:58.848963 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9daf0df0-dd5e-4742-a007-9138f3fc7fa0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:58.849723 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9daf0df0-dd5e-4742-a007-9138f3fc7fa0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:58.850153 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9daf0df0-dd5e-4742-a007-9138f3fc7fa0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:58.870884 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b622ca4f-a9e1-4a70-9268-823ccb06736b tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:58.871492 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b622ca4f-a9e1-4a70-9268-823ccb06736b tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:58.877848 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b622ca4f-a9e1-4a70-9268-823ccb06736b tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:58.878346 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b622ca4f-a9e1-4a70-9268-823ccb06736b tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:58.879138 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b622ca4f-a9e1-4a70-9268-823ccb06736b tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:58.879560 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b622ca4f-a9e1-4a70-9268-823ccb06736b tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:59.056787 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-9daf0df0-dd5e-4742-a007-9138f3fc7fa0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:59.062221 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9daf0df0-dd5e-4742-a007-9138f3fc7fa0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1362 microversion: 2.1 time: 0.223728 Feb 21 01:32:59.063020 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 106/205] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:58 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:59.078356 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b622ca4f-a9e1-4a70-9268-823ccb06736b tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:59.087503 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b622ca4f-a9e1-4a70-9268-823ccb06736b tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1317 microversion: 2.1 time: 0.220275 Feb 21 01:32:59.088076 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 100/206] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:58 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:59.115924 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dca59218-dd33-4337-a677-501fe0536dd9 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:59.116588 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dca59218-dd33-4337-a677-501fe0536dd9 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:59.122557 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dca59218-dd33-4337-a677-501fe0536dd9 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:59.123796 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dca59218-dd33-4337-a677-501fe0536dd9 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:59.124684 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dca59218-dd33-4337-a677-501fe0536dd9 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:59.125037 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dca59218-dd33-4337-a677-501fe0536dd9 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:59.282918 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-dca59218-dd33-4337-a677-501fe0536dd9 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:59.289990 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dca59218-dd33-4337-a677-501fe0536dd9 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1322 microversion: 2.1 time: 0.178138 Feb 21 01:32:59.290541 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 107/207] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:59 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:32:59.518630 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-6be8b51e-e01d-47f2-a4bd-1fa0aa56db2f req-d12b1ac2-164e-4a6e-9e63-16a94c29dc26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "962b0526-5a3e-4044-a74f-34fe41f7717d", "name": "network-vif-plugged", "status": "completed", "tag": "d7edbb2e-2fa7-4065-ba3b-97a6d16d31e7"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:32:59.520325 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:32:59.520325 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:32:59.527461 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6be8b51e-e01d-47f2-a4bd-1fa0aa56db2f req-d12b1ac2-164e-4a6e-9e63-16a94c29dc26 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:59.527896 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6be8b51e-e01d-47f2-a4bd-1fa0aa56db2f req-d12b1ac2-164e-4a6e-9e63-16a94c29dc26 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:59.538508 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-6be8b51e-e01d-47f2-a4bd-1fa0aa56db2f req-d12b1ac2-164e-4a6e-9e63-16a94c29dc26 service nova] Creating event network-vif-plugged:d7edbb2e-2fa7-4065-ba3b-97a6d16d31e7 for instance 962b0526-5a3e-4044-a74f-34fe41f7717d on hv-cinder-81322 Feb 21 01:32:59.543720 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-6be8b51e-e01d-47f2-a4bd-1fa0aa56db2f req-d12b1ac2-164e-4a6e-9e63-16a94c29dc26 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028821 Feb 21 01:32:59.544331 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 101/208] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:32:59.653361 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1a319a25-2c03-44a2-9f9a-568c735fa242 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:59.653970 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1a319a25-2c03-44a2-9f9a-568c735fa242 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:59.660215 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a319a25-2c03-44a2-9f9a-568c735fa242 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:59.660724 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a319a25-2c03-44a2-9f9a-568c735fa242 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:59.661183 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f203ba75-b645-4fed-b6cc-026dbc4f0af6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:32:59.661496 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a319a25-2c03-44a2-9f9a-568c735fa242 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:59.661911 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f203ba75-b645-4fed-b6cc-026dbc4f0af6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:32:59.662027 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a319a25-2c03-44a2-9f9a-568c735fa242 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:59.667791 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f203ba75-b645-4fed-b6cc-026dbc4f0af6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:59.668240 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f203ba75-b645-4fed-b6cc-026dbc4f0af6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:59.672153 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f203ba75-b645-4fed-b6cc-026dbc4f0af6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:32:59.672153 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f203ba75-b645-4fed-b6cc-026dbc4f0af6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:32:59.932585 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-1a319a25-2c03-44a2-9f9a-568c735fa242 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:59.938903 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-f203ba75-b645-4fed-b6cc-026dbc4f0af6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:59.947386 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1a319a25-2c03-44a2-9f9a-568c735fa242 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.297699 Feb 21 01:32:59.947556 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-f203ba75-b645-4fed-b6cc-026dbc4f0af6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:59.948107 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 108/209] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:32:59 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:32:59.949556 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-f203ba75-b645-4fed-b6cc-026dbc4f0af6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:32:59.951117 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f203ba75-b645-4fed-b6cc-026dbc4f0af6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1406 microversion: 2.20 time: 0.293786 Feb 21 01:32:59.961982 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 102/210] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:32:59 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1406 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:33:00.079297 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cdd9fbe0-c8d3-4853-8be1-4aaf52f6fd68 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:00.079948 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cdd9fbe0-c8d3-4853-8be1-4aaf52f6fd68 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:00.085708 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cdd9fbe0-c8d3-4853-8be1-4aaf52f6fd68 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:00.086148 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cdd9fbe0-c8d3-4853-8be1-4aaf52f6fd68 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:00.086915 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cdd9fbe0-c8d3-4853-8be1-4aaf52f6fd68 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:00.087332 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cdd9fbe0-c8d3-4853-8be1-4aaf52f6fd68 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:00.106178 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9ce5f939-51a0-4875-9c8f-b13d36290500 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:00.106786 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9ce5f939-51a0-4875-9c8f-b13d36290500 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:00.114061 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ce5f939-51a0-4875-9c8f-b13d36290500 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:00.114508 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ce5f939-51a0-4875-9c8f-b13d36290500 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:00.115340 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ce5f939-51a0-4875-9c8f-b13d36290500 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:00.115816 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9ce5f939-51a0-4875-9c8f-b13d36290500 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:00.302892 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-cdd9fbe0-c8d3-4853-8be1-4aaf52f6fd68 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:00.305294 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-9ce5f939-51a0-4875-9c8f-b13d36290500 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:00.310769 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cdd9fbe0-c8d3-4853-8be1-4aaf52f6fd68 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1362 microversion: 2.1 time: 0.235243 Feb 21 01:33:00.314252 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9ce5f939-51a0-4875-9c8f-b13d36290500 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1506 microversion: 2.1 time: 0.211611 Feb 21 01:33:00.315094 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 103/211] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:00 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1506 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:33:00.320380 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 109/212] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:00 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:00.329951 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6af9756d-ae77-497d-afa8-12bcc75c51bd tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:00.330844 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6af9756d-ae77-497d-afa8-12bcc75c51bd tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:00.341887 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6af9756d-ae77-497d-afa8-12bcc75c51bd tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:00.342649 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6af9756d-ae77-497d-afa8-12bcc75c51bd tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:00.343810 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6af9756d-ae77-497d-afa8-12bcc75c51bd tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:00.344228 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6af9756d-ae77-497d-afa8-12bcc75c51bd tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:00.541322 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-6af9756d-ae77-497d-afa8-12bcc75c51bd tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:00.549054 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6af9756d-ae77-497d-afa8-12bcc75c51bd tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1322 microversion: 2.1 time: 0.232756 Feb 21 01:33:00.549720 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 104/213] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:00 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:00.964314 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e0976c3e-4daf-4207-a0fc-60f563a6daad tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:00.965065 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e0976c3e-4daf-4207-a0fc-60f563a6daad tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:00.970950 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6d48dfc4-5601-4f9c-be44-27447543bbe8 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:00.971240 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0976c3e-4daf-4207-a0fc-60f563a6daad tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:00.971556 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6d48dfc4-5601-4f9c-be44-27447543bbe8 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:00.971891 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0976c3e-4daf-4207-a0fc-60f563a6daad tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:00.972833 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0976c3e-4daf-4207-a0fc-60f563a6daad tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:00.973549 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e0976c3e-4daf-4207-a0fc-60f563a6daad tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:00.977723 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d48dfc4-5601-4f9c-be44-27447543bbe8 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:00.978168 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d48dfc4-5601-4f9c-be44-27447543bbe8 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:00.978936 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d48dfc4-5601-4f9c-be44-27447543bbe8 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:00.979778 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d48dfc4-5601-4f9c-be44-27447543bbe8 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:01.408114 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-6d48dfc4-5601-4f9c-be44-27447543bbe8 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:01.410431 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-e0976c3e-4daf-4207-a0fc-60f563a6daad tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:01.417596 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e0976c3e-4daf-4207-a0fc-60f563a6daad tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1314 microversion: 2.1 time: 0.456862 Feb 21 01:33:01.417784 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-6d48dfc4-5601-4f9c-be44-27447543bbe8 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:01.427023 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-6d48dfc4-5601-4f9c-be44-27447543bbe8 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:01.427023 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6d48dfc4-5601-4f9c-be44-27447543bbe8 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1406 microversion: 2.20 time: 0.453801 Feb 21 01:33:01.427023 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 105/214] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:33:00 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1406 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:33:01.427956 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 110/215] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:00 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:01.431639 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8ae823f5-24cb-40b1-891f-ec5b76007202 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:01.432398 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8ae823f5-24cb-40b1-891f-ec5b76007202 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:01.439963 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ae823f5-24cb-40b1-891f-ec5b76007202 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:01.440638 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ae823f5-24cb-40b1-891f-ec5b76007202 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:01.441601 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ae823f5-24cb-40b1-891f-ec5b76007202 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:01.442045 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ae823f5-24cb-40b1-891f-ec5b76007202 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:01.566381 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9e44365f-aace-4eda-9c9f-5858cf48ab50 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:01.567045 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9e44365f-aace-4eda-9c9f-5858cf48ab50 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:01.572906 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e44365f-aace-4eda-9c9f-5858cf48ab50 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:01.573357 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e44365f-aace-4eda-9c9f-5858cf48ab50 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:01.574141 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e44365f-aace-4eda-9c9f-5858cf48ab50 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:01.574575 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e44365f-aace-4eda-9c9f-5858cf48ab50 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:01.593942 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-8ae823f5-24cb-40b1-891f-ec5b76007202 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:01.601395 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8ae823f5-24cb-40b1-891f-ec5b76007202 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1362 microversion: 2.1 time: 0.175478 Feb 21 01:33:01.611265 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 106/216] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:01 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:01.726986 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-9e44365f-aace-4eda-9c9f-5858cf48ab50 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:01.734324 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9e44365f-aace-4eda-9c9f-5858cf48ab50 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1515 microversion: 2.1 time: 0.172477 Feb 21 01:33:01.734898 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 111/217] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:01 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:33:01.751101 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9f8a7f63-ab67-463f-a7c5-0426a44bcb76 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:33:01.752069 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9f8a7f63-ab67-463f-a7c5-0426a44bcb76 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:01.758092 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f8a7f63-ab67-463f-a7c5-0426a44bcb76 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:01.758531 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f8a7f63-ab67-463f-a7c5-0426a44bcb76 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:01.759284 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f8a7f63-ab67-463f-a7c5-0426a44bcb76 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:01.759712 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9f8a7f63-ab67-463f-a7c5-0426a44bcb76 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:01.826670 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-9f8a7f63-ab67-463f-a7c5-0426a44bcb76 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lazy-loading 'flavor' on Instance uuid 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:33:02.167142 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9f8a7f63-ab67-463f-a7c5-0426a44bcb76 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "POST /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8/action" status: 200 len: 32 microversion: 2.1 time: 0.420203 Feb 21 01:33:02.167736 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 107/218] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Feb 21 01:33:01 2022] POST /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8/action => generated 32 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 01:33:02.177247 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-586f604d-023f-4652-9051-c34e49c95d06 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:02.178600 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-586f604d-023f-4652-9051-c34e49c95d06 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:02.186406 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-586f604d-023f-4652-9051-c34e49c95d06 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:02.187113 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-586f604d-023f-4652-9051-c34e49c95d06 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:02.188150 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-586f604d-023f-4652-9051-c34e49c95d06 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:02.188692 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-586f604d-023f-4652-9051-c34e49c95d06 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:02.350225 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-586f604d-023f-4652-9051-c34e49c95d06 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:02.358086 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-586f604d-023f-4652-9051-c34e49c95d06 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.184652 Feb 21 01:33:02.358665 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 112/219] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:02 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:02.434912 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6613107a-4b13-4b21-9535-37aafcd3e47a tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:02.436524 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6613107a-4b13-4b21-9535-37aafcd3e47a tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:02.442489 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-32c37e0e-c3d4-4236-8d2a-fc401d06f2cb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:02.443435 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-32c37e0e-c3d4-4236-8d2a-fc401d06f2cb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:02.443990 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6613107a-4b13-4b21-9535-37aafcd3e47a tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:02.444916 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6613107a-4b13-4b21-9535-37aafcd3e47a tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:02.445742 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6613107a-4b13-4b21-9535-37aafcd3e47a tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:02.446185 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6613107a-4b13-4b21-9535-37aafcd3e47a tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:02.452258 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32c37e0e-c3d4-4236-8d2a-fc401d06f2cb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:02.452869 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32c37e0e-c3d4-4236-8d2a-fc401d06f2cb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:02.454080 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32c37e0e-c3d4-4236-8d2a-fc401d06f2cb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:02.454870 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32c37e0e-c3d4-4236-8d2a-fc401d06f2cb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:02.780876 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-32c37e0e-c3d4-4236-8d2a-fc401d06f2cb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:02.785977 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-6613107a-4b13-4b21-9535-37aafcd3e47a tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:02.790156 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-32c37e0e-c3d4-4236-8d2a-fc401d06f2cb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:02.800274 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-32c37e0e-c3d4-4236-8d2a-fc401d06f2cb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:02.800274 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-32c37e0e-c3d4-4236-8d2a-fc401d06f2cb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1406 microversion: 2.20 time: 0.354559 Feb 21 01:33:02.800274 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 113/220] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:33:02 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1406 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:33:02.800274 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8c48a09f-4b1d-4dd1-af1c-06c967392189 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:02.800754 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6613107a-4b13-4b21-9535-37aafcd3e47a tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1501 microversion: 2.1 time: 0.368115 Feb 21 01:33:02.800833 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8c48a09f-4b1d-4dd1-af1c-06c967392189 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:02.800903 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 108/221] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:02 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1501 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:02.808339 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c48a09f-4b1d-4dd1-af1c-06c967392189 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:02.808830 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c48a09f-4b1d-4dd1-af1c-06c967392189 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:02.809628 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c48a09f-4b1d-4dd1-af1c-06c967392189 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:02.810099 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c48a09f-4b1d-4dd1-af1c-06c967392189 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:02.982947 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-8c48a09f-4b1d-4dd1-af1c-06c967392189 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:02.990183 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8c48a09f-4b1d-4dd1-af1c-06c967392189 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1548 microversion: 2.1 time: 0.195774 Feb 21 01:33:02.990743 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 114/222] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:02 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1548 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:03.006898 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aba7cc6f-6c07-4f00-8000-d67357a2ad9c tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:03.007864 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-aba7cc6f-6c07-4f00-8000-d67357a2ad9c tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:03.014305 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aba7cc6f-6c07-4f00-8000-d67357a2ad9c tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:03.014866 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aba7cc6f-6c07-4f00-8000-d67357a2ad9c tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:03.015696 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aba7cc6f-6c07-4f00-8000-d67357a2ad9c tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:03.016220 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aba7cc6f-6c07-4f00-8000-d67357a2ad9c tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:03.049018 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6e0643e0-ee34-412c-8216-b8806fe3b070 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3342dd83-9294-4ece-be20-e74cb7e16c6d"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:33:03.050235 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6e0643e0-ee34-412c-8216-b8806fe3b070 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:03.056116 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e0643e0-ee34-412c-8216-b8806fe3b070 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:03.056671 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e0643e0-ee34-412c-8216-b8806fe3b070 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:03.057551 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e0643e0-ee34-412c-8216-b8806fe3b070 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:03.058106 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6e0643e0-ee34-412c-8216-b8806fe3b070 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:03.101714 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-aba7cc6f-6c07-4f00-8000-d67357a2ad9c tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098501 Feb 21 01:33:03.102334 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 109/223] 10.222.0.90 () {58 vars in 1274 bytes} [Mon Feb 21 01:33:03 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:33:03.386961 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-67dbf05e-0e00-4667-aa0c-28bb91d1e832 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:03.387633 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-67dbf05e-0e00-4667-aa0c-28bb91d1e832 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:03.394555 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-67dbf05e-0e00-4667-aa0c-28bb91d1e832 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:03.395621 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-67dbf05e-0e00-4667-aa0c-28bb91d1e832 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:03.396585 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-67dbf05e-0e00-4667-aa0c-28bb91d1e832 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:03.397189 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-67dbf05e-0e00-4667-aa0c-28bb91d1e832 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:03.734929 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-67dbf05e-0e00-4667-aa0c-28bb91d1e832 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:03.742423 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-67dbf05e-0e00-4667-aa0c-28bb91d1e832 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.360246 Feb 21 01:33:03.742998 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 110/224] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:03 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:33:03.811534 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6551abd9-2858-45db-bb10-fd81b76e3d23 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:03.812189 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6551abd9-2858-45db-bb10-fd81b76e3d23 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:03.817884 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6551abd9-2858-45db-bb10-fd81b76e3d23 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:03.818451 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6551abd9-2858-45db-bb10-fd81b76e3d23 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:03.819223 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6551abd9-2858-45db-bb10-fd81b76e3d23 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:03.819651 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6551abd9-2858-45db-bb10-fd81b76e3d23 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:04.234234 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-6551abd9-2858-45db-bb10-fd81b76e3d23 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:04.244178 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-6551abd9-2858-45db-bb10-fd81b76e3d23 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:04.247746 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-6551abd9-2858-45db-bb10-fd81b76e3d23 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:04.248789 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6551abd9-2858-45db-bb10-fd81b76e3d23 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1598 microversion: 2.20 time: 0.441555 Feb 21 01:33:04.261638 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 111/225] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:33:03 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1598 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:33:04.267776 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a52a2930-9454-4c40-90bc-dc81fc117da2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:04.268318 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a52a2930-9454-4c40-90bc-dc81fc117da2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:04.275586 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a52a2930-9454-4c40-90bc-dc81fc117da2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:04.276030 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a52a2930-9454-4c40-90bc-dc81fc117da2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:04.276889 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a52a2930-9454-4c40-90bc-dc81fc117da2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:04.277296 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a52a2930-9454-4c40-90bc-dc81fc117da2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:04.408826 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a52a2930-9454-4c40-90bc-dc81fc117da2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.145473 Feb 21 01:33:04.409502 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 112/226] 10.222.0.90 () {60 vars in 1315 bytes} [Mon Feb 21 01:33:04 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d/os-interface => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 01:33:04.751966 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-12e8a226-d526-4a2f-95b1-ab2747739032 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:04.757898 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-12e8a226-d526-4a2f-95b1-ab2747739032 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:04.759842 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12e8a226-d526-4a2f-95b1-ab2747739032 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:04.760657 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12e8a226-d526-4a2f-95b1-ab2747739032 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:04.761099 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12e8a226-d526-4a2f-95b1-ab2747739032 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:04.761524 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-12e8a226-d526-4a2f-95b1-ab2747739032 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:04.785597 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-12e8a226-d526-4a2f-95b1-ab2747739032 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd/ips" status: 200 len: 106 microversion: 2.1 time: 0.039863 Feb 21 01:33:04.786397 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 113/227] 10.222.0.90 () {58 vars in 1247 bytes} [Mon Feb 21 01:33:04 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd/ips => generated 106 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:33:04.790957 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-af6ec50e-f12b-4e98-9723-9768e25a851c req-d0c9e491-8817-4f61-90e3-cef1427e3895 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff526a32-96c9-4481-a88c-a0913652acfd", "tag": "fe876a1a-56e9-4821-ac6c-94fe28a1852e"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:33:04.792740 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:33:04.792740 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:33:04.809038 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-af6ec50e-f12b-4e98-9723-9768e25a851c req-d0c9e491-8817-4f61-90e3-cef1427e3895 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:04.809468 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-af6ec50e-f12b-4e98-9723-9768e25a851c req-d0c9e491-8817-4f61-90e3-cef1427e3895 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:04.821363 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-af6ec50e-f12b-4e98-9723-9768e25a851c req-d0c9e491-8817-4f61-90e3-cef1427e3895 service nova] Creating event network-changed:fe876a1a-56e9-4821-ac6c-94fe28a1852e for instance ff526a32-96c9-4481-a88c-a0913652acfd on hv-cinder-81322 Feb 21 01:33:04.827024 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-af6ec50e-f12b-4e98-9723-9768e25a851c req-d0c9e491-8817-4f61-90e3-cef1427e3895 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039345 Feb 21 01:33:04.827613 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 114/228] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:33:04.833567 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-83992819-160e-4f82-b656-6acc483953c4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:04.834413 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-83992819-160e-4f82-b656-6acc483953c4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:04.840599 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83992819-160e-4f82-b656-6acc483953c4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:04.843269 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83992819-160e-4f82-b656-6acc483953c4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:04.843269 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83992819-160e-4f82-b656-6acc483953c4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:04.843269 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-83992819-160e-4f82-b656-6acc483953c4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:04.979979 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-83992819-160e-4f82-b656-6acc483953c4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:04.987514 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-83992819-160e-4f82-b656-6acc483953c4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.158381 Feb 21 01:33:04.998560 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 115/229] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:04 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:06.005844 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-70ca42bc-f8a7-4c0f-bffb-22888e3269db tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:06.007947 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-70ca42bc-f8a7-4c0f-bffb-22888e3269db tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:06.019167 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-70ca42bc-f8a7-4c0f-bffb-22888e3269db tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:06.019786 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-70ca42bc-f8a7-4c0f-bffb-22888e3269db tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:06.021178 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-70ca42bc-f8a7-4c0f-bffb-22888e3269db tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:06.021850 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-70ca42bc-f8a7-4c0f-bffb-22888e3269db tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:06.167809 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-70ca42bc-f8a7-4c0f-bffb-22888e3269db tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:06.176054 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-70ca42bc-f8a7-4c0f-bffb-22888e3269db tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.174582 Feb 21 01:33:06.177226 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 116/230] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:06 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:06.189244 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-745aeb0d-6a22-4066-93af-2d1a5fd84804 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:06.190420 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-745aeb0d-6a22-4066-93af-2d1a5fd84804 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:06.197577 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-745aeb0d-6a22-4066-93af-2d1a5fd84804 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:06.198474 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-745aeb0d-6a22-4066-93af-2d1a5fd84804 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:06.199452 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-745aeb0d-6a22-4066-93af-2d1a5fd84804 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:06.199884 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-745aeb0d-6a22-4066-93af-2d1a5fd84804 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:06.227488 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-745aeb0d-6a22-4066-93af-2d1a5fd84804 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d/ips" status: 200 len: 112 microversion: 2.20 time: 0.048923 Feb 21 01:33:06.228295 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 117/231] 10.222.0.90 () {60 vars in 1288 bytes} [Mon Feb 21 01:33:06 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d/ips => generated 112 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:33:06.232991 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-c5836e57-cd6b-442e-b28b-8997c4299d3a req-15b58731-a214-4a76-bc84-e3ed11ccd905 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "962b0526-5a3e-4044-a74f-34fe41f7717d", "tag": "d7edbb2e-2fa7-4065-ba3b-97a6d16d31e7"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:33:06.234610 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:33:06.234610 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:33:06.246806 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c5836e57-cd6b-442e-b28b-8997c4299d3a req-15b58731-a214-4a76-bc84-e3ed11ccd905 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:06.247308 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c5836e57-cd6b-442e-b28b-8997c4299d3a req-15b58731-a214-4a76-bc84-e3ed11ccd905 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:06.270183 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-c5836e57-cd6b-442e-b28b-8997c4299d3a req-15b58731-a214-4a76-bc84-e3ed11ccd905 service nova] Creating event network-changed:d7edbb2e-2fa7-4065-ba3b-97a6d16d31e7 for instance 962b0526-5a3e-4044-a74f-34fe41f7717d on hv-cinder-81322 Feb 21 01:33:06.276387 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-c5836e57-cd6b-442e-b28b-8997c4299d3a req-15b58731-a214-4a76-bc84-e3ed11ccd905 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046060 Feb 21 01:33:06.277876 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 118/232] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:33:07.193780 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5bb616d3-6ae5-45ed-b7da-c4a343616e99 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:07.194461 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5bb616d3-6ae5-45ed-b7da-c4a343616e99 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:07.201696 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bb616d3-6ae5-45ed-b7da-c4a343616e99 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:07.202202 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bb616d3-6ae5-45ed-b7da-c4a343616e99 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:07.207222 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bb616d3-6ae5-45ed-b7da-c4a343616e99 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:07.207222 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bb616d3-6ae5-45ed-b7da-c4a343616e99 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:07.355031 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-5bb616d3-6ae5-45ed-b7da-c4a343616e99 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:07.363547 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5bb616d3-6ae5-45ed-b7da-c4a343616e99 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.173635 Feb 21 01:33:07.364171 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 119/233] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:07 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:33:08.382137 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e265db8f-b877-4e04-a97c-7bead8a34e9d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:08.384356 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e265db8f-b877-4e04-a97c-7bead8a34e9d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:08.391773 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e265db8f-b877-4e04-a97c-7bead8a34e9d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:08.392749 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e265db8f-b877-4e04-a97c-7bead8a34e9d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:08.394089 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e265db8f-b877-4e04-a97c-7bead8a34e9d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:08.395201 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e265db8f-b877-4e04-a97c-7bead8a34e9d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:08.742753 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6e0643e0-ee34-412c-8216-b8806fe3b070 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "POST /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.696734 Feb 21 01:33:08.745182 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 115/234] 10.222.0.90 () {60 vars in 1322 bytes} [Mon Feb 21 01:33:03 2022] POST /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e/os-volume_attachments => generated 194 bytes in 5702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:33:08.822320 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-e265db8f-b877-4e04-a97c-7bead8a34e9d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:08.825017 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e265db8f-b877-4e04-a97c-7bead8a34e9d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.446685 Feb 21 01:33:08.834472 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 120/235] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:08 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:33:09.804511 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7a2752c5-d294-4a40-be42-046c84311b85 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7f9152a-3e6f-42bb-a8fc-94f67190686f"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:33:09.805828 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7a2752c5-d294-4a40-be42-046c84311b85 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:09.813779 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a2752c5-d294-4a40-be42-046c84311b85 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:09.814303 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a2752c5-d294-4a40-be42-046c84311b85 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:09.815191 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a2752c5-d294-4a40-be42-046c84311b85 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:09.815701 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a2752c5-d294-4a40-be42-046c84311b85 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:09.842483 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ff0d5375-d8d9-4c1f-966d-44a9b3c1ee85 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:09.843936 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ff0d5375-d8d9-4c1f-966d-44a9b3c1ee85 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:09.851261 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff0d5375-d8d9-4c1f-966d-44a9b3c1ee85 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:09.852078 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff0d5375-d8d9-4c1f-966d-44a9b3c1ee85 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:09.853477 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff0d5375-d8d9-4c1f-966d-44a9b3c1ee85 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:09.854347 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff0d5375-d8d9-4c1f-966d-44a9b3c1ee85 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:09.999743 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-ff0d5375-d8d9-4c1f-966d-44a9b3c1ee85 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:10.007192 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ff0d5375-d8d9-4c1f-966d-44a9b3c1ee85 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.169152 Feb 21 01:33:10.008031 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 121/236] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:09 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:33:10.559155 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7a2752c5-d294-4a40-be42-046c84311b85 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "POST /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.758783 Feb 21 01:33:10.560089 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 116/237] 10.222.0.90 () {60 vars in 1322 bytes} [Mon Feb 21 01:33:09 2022] POST /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc/os-volume_attachments => generated 194 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:33:11.024179 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5cf13107-9e00-472d-9b22-98673dffd84d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:11.024827 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5cf13107-9e00-472d-9b22-98673dffd84d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:11.031618 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cf13107-9e00-472d-9b22-98673dffd84d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:11.032069 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cf13107-9e00-472d-9b22-98673dffd84d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:11.032890 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cf13107-9e00-472d-9b22-98673dffd84d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:11.033325 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5cf13107-9e00-472d-9b22-98673dffd84d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:11.161578 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-5cf13107-9e00-472d-9b22-98673dffd84d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:11.168755 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5cf13107-9e00-472d-9b22-98673dffd84d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.148233 Feb 21 01:33:11.169887 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 122/238] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:11 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:12.187612 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a8d6014d-04b4-46a0-994d-3c7a1fecd093 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:12.188315 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a8d6014d-04b4-46a0-994d-3c7a1fecd093 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:12.194530 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a8d6014d-04b4-46a0-994d-3c7a1fecd093 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:12.194982 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a8d6014d-04b4-46a0-994d-3c7a1fecd093 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:12.195768 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a8d6014d-04b4-46a0-994d-3c7a1fecd093 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:12.196205 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a8d6014d-04b4-46a0-994d-3c7a1fecd093 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:12.328400 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-a8d6014d-04b4-46a0-994d-3c7a1fecd093 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:12.335800 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a8d6014d-04b4-46a0-994d-3c7a1fecd093 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.153418 Feb 21 01:33:12.336366 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 117/239] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:12 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:13.353572 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1cc80d03-be7d-405a-9262-7a19a54382f8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:13.354192 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1cc80d03-be7d-405a-9262-7a19a54382f8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:13.360709 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1cc80d03-be7d-405a-9262-7a19a54382f8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:13.361192 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1cc80d03-be7d-405a-9262-7a19a54382f8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:13.362032 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1cc80d03-be7d-405a-9262-7a19a54382f8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:13.362465 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1cc80d03-be7d-405a-9262-7a19a54382f8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:13.499837 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1cc80d03-be7d-405a-9262-7a19a54382f8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:13.509107 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1cc80d03-be7d-405a-9262-7a19a54382f8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.159383 Feb 21 01:33:13.509698 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 123/240] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:13 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:14.525767 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-90a93566-b9f2-48f5-9bfa-e90effc57a65 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:14.526376 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-90a93566-b9f2-48f5-9bfa-e90effc57a65 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:14.532831 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-90a93566-b9f2-48f5-9bfa-e90effc57a65 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:14.533274 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-90a93566-b9f2-48f5-9bfa-e90effc57a65 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:14.534041 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-90a93566-b9f2-48f5-9bfa-e90effc57a65 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:14.534464 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-90a93566-b9f2-48f5-9bfa-e90effc57a65 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:14.669285 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-90a93566-b9f2-48f5-9bfa-e90effc57a65 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:14.676743 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-90a93566-b9f2-48f5-9bfa-e90effc57a65 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.154682 Feb 21 01:33:14.677471 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 118/241] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:14 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:15.698921 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-142fda4f-0e2f-4f66-a931-d5aa9511477e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:15.698921 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-142fda4f-0e2f-4f66-a931-d5aa9511477e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:15.701857 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-142fda4f-0e2f-4f66-a931-d5aa9511477e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:15.702298 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-142fda4f-0e2f-4f66-a931-d5aa9511477e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:15.703105 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-142fda4f-0e2f-4f66-a931-d5aa9511477e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:15.703535 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-142fda4f-0e2f-4f66-a931-d5aa9511477e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:15.834665 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-142fda4f-0e2f-4f66-a931-d5aa9511477e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:15.842491 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-142fda4f-0e2f-4f66-a931-d5aa9511477e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.151226 Feb 21 01:33:15.843067 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 124/242] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:15 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:16.859341 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9577f8c3-c337-4470-a6f6-c511e9624b1e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:16.859945 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9577f8c3-c337-4470-a6f6-c511e9624b1e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:16.866141 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9577f8c3-c337-4470-a6f6-c511e9624b1e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:16.866588 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9577f8c3-c337-4470-a6f6-c511e9624b1e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:16.867383 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9577f8c3-c337-4470-a6f6-c511e9624b1e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:16.867813 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9577f8c3-c337-4470-a6f6-c511e9624b1e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:17.015359 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-9577f8c3-c337-4470-a6f6-c511e9624b1e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:17.022529 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9577f8c3-c337-4470-a6f6-c511e9624b1e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.167445 Feb 21 01:33:17.023162 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 119/243] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:16 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:33:18.038856 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-58ae4571-e97e-4a91-81b4-a8862b722e99 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:18.039739 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-58ae4571-e97e-4a91-81b4-a8862b722e99 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:18.045563 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58ae4571-e97e-4a91-81b4-a8862b722e99 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:18.046542 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58ae4571-e97e-4a91-81b4-a8862b722e99 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:18.047313 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58ae4571-e97e-4a91-81b4-a8862b722e99 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:18.047744 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-58ae4571-e97e-4a91-81b4-a8862b722e99 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:18.189546 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-58ae4571-e97e-4a91-81b4-a8862b722e99 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:18.198402 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-58ae4571-e97e-4a91-81b4-a8862b722e99 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.163275 Feb 21 01:33:18.199444 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 125/244] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:18 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:19.217424 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9ea26398-aee1-4cb0-a6b1-e11e15bd15d2 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:19.218554 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9ea26398-aee1-4cb0-a6b1-e11e15bd15d2 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:19.224764 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ea26398-aee1-4cb0-a6b1-e11e15bd15d2 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:19.225664 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ea26398-aee1-4cb0-a6b1-e11e15bd15d2 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:19.226058 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ea26398-aee1-4cb0-a6b1-e11e15bd15d2 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:19.226482 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9ea26398-aee1-4cb0-a6b1-e11e15bd15d2 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:19.358482 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-9ea26398-aee1-4cb0-a6b1-e11e15bd15d2 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:19.366710 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9ea26398-aee1-4cb0-a6b1-e11e15bd15d2 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.152620 Feb 21 01:33:19.371861 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 120/245] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:19 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:20.383036 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ac7ec689-aebe-45b2-ac0d-c96207d8a7b6 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:20.383683 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ac7ec689-aebe-45b2-ac0d-c96207d8a7b6 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:20.389914 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac7ec689-aebe-45b2-ac0d-c96207d8a7b6 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:20.390360 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac7ec689-aebe-45b2-ac0d-c96207d8a7b6 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:20.391150 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac7ec689-aebe-45b2-ac0d-c96207d8a7b6 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:20.391552 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac7ec689-aebe-45b2-ac0d-c96207d8a7b6 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:20.527757 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-ac7ec689-aebe-45b2-ac0d-c96207d8a7b6 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:20.535488 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ac7ec689-aebe-45b2-ac0d-c96207d8a7b6 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.156368 Feb 21 01:33:20.536058 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 126/246] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:20 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:21.552062 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ec7e8aeb-e2c1-4737-99fb-b4470e03b793 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:21.552642 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ec7e8aeb-e2c1-4737-99fb-b4470e03b793 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:21.558721 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec7e8aeb-e2c1-4737-99fb-b4470e03b793 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:21.559254 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec7e8aeb-e2c1-4737-99fb-b4470e03b793 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:21.560035 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec7e8aeb-e2c1-4737-99fb-b4470e03b793 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:21.560475 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec7e8aeb-e2c1-4737-99fb-b4470e03b793 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:21.694174 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ec7e8aeb-e2c1-4737-99fb-b4470e03b793 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:21.701302 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ec7e8aeb-e2c1-4737-99fb-b4470e03b793 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.153029 Feb 21 01:33:21.701981 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 121/247] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:21 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:22.724781 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-21226dfd-1af0-4e3f-95be-2d280cc02c05 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:22.725388 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-21226dfd-1af0-4e3f-95be-2d280cc02c05 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:22.731418 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21226dfd-1af0-4e3f-95be-2d280cc02c05 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:22.731868 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21226dfd-1af0-4e3f-95be-2d280cc02c05 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:22.732679 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21226dfd-1af0-4e3f-95be-2d280cc02c05 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:22.733111 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-21226dfd-1af0-4e3f-95be-2d280cc02c05 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:22.868297 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-21226dfd-1af0-4e3f-95be-2d280cc02c05 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:22.876616 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-21226dfd-1af0-4e3f-95be-2d280cc02c05 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.155456 Feb 21 01:33:22.877176 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 127/248] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:22 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:23.895087 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-762d2de4-7bc1-4401-9e4d-cdc783b0989e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:23.895759 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-762d2de4-7bc1-4401-9e4d-cdc783b0989e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:23.902318 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-762d2de4-7bc1-4401-9e4d-cdc783b0989e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:23.902949 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-762d2de4-7bc1-4401-9e4d-cdc783b0989e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:23.903535 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-762d2de4-7bc1-4401-9e4d-cdc783b0989e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:23.904091 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-762d2de4-7bc1-4401-9e4d-cdc783b0989e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:24.060896 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-762d2de4-7bc1-4401-9e4d-cdc783b0989e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:24.068671 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-762d2de4-7bc1-4401-9e4d-cdc783b0989e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.177354 Feb 21 01:33:24.069275 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 122/249] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:23 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:25.085311 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c8871a5e-5813-4ff0-84a6-558dc313b7e1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:25.085919 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c8871a5e-5813-4ff0-84a6-558dc313b7e1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:25.091601 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8871a5e-5813-4ff0-84a6-558dc313b7e1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:25.092038 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8871a5e-5813-4ff0-84a6-558dc313b7e1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:25.092837 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8871a5e-5813-4ff0-84a6-558dc313b7e1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:25.093270 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8871a5e-5813-4ff0-84a6-558dc313b7e1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:25.281571 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-c8871a5e-5813-4ff0-84a6-558dc313b7e1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:25.287907 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c8871a5e-5813-4ff0-84a6-558dc313b7e1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.206144 Feb 21 01:33:25.288499 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 128/250] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:25 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:25.309221 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8ed41a30-b6e0-493b-a7fb-93ca9f8bf64d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-159383328", "imageRef": "35936a71-5ec3-4154-b01a-f2dafd8c0364", "flavorRef": "452", "networks": [{"uuid": "19c3a3ee-4943-4cb3-b92f-e4a4ed0d979a"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:33:25.363669 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-8ed41a30-b6e0-493b-a7fb-93ca9f8bf64d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] validate_networks() for [('19c3a3ee-4943-4cb3-b92f-e4a4ed0d979a', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:33:25.762151 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-8ed41a30-b6e0-493b-a7fb-93ca9f8bf64d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:33:25.762151 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-8ed41a30-b6e0-493b-a7fb-93ca9f8bf64d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:33:25.762151 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-8ed41a30-b6e0-493b-a7fb-93ca9f8bf64d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:33:25.762429 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-8ed41a30-b6e0-493b-a7fb-93ca9f8bf64d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:33:25.762666 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-8ed41a30-b6e0-493b-a7fb-93ca9f8bf64d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:33:25.771261 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ed41a30-b6e0-493b-a7fb-93ca9f8bf64d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:25.771699 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ed41a30-b6e0-493b-a7fb-93ca9f8bf64d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:25.772633 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ed41a30-b6e0-493b-a7fb-93ca9f8bf64d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:25.773065 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8ed41a30-b6e0-493b-a7fb-93ca9f8bf64d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:25.789398 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-8ed41a30-b6e0-493b-a7fb-93ca9f8bf64d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Getting quotas for project 11d99a6bb8ad42a980e51a57fcec7315. Resources: {'ram', 'cores', 'instances'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:33:25.793241 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-8ed41a30-b6e0-493b-a7fb-93ca9f8bf64d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Getting quotas for user 35d4828335a543758d1413c0276657a6 and project 11d99a6bb8ad42a980e51a57fcec7315. Resources: {'ram', 'cores', 'instances'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:33:25.804245 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8ed41a30-b6e0-493b-a7fb-93ca9f8bf64d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:33:25.807279 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8ed41a30-b6e0-493b-a7fb-93ca9f8bf64d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 41a646dd-0c47-4fe4-8727-3fe9925c80c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35936a71-5ec3-4154-b01a-f2dafd8c0364',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:33:25.963385 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8ed41a30-b6e0-493b-a7fb-93ca9f8bf64d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657889 Feb 21 01:33:25.964024 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 123/251] 10.222.0.90 () {60 vars in 1146 bytes} [Mon Feb 21 01:33:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:33:25.974199 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9f2c87fe-7634-4107-b2fa-6e6ce54b949a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:25.974827 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9f2c87fe-7634-4107-b2fa-6e6ce54b949a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 41a646dd-0c47-4fe4-8727-3fe9925c80c7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:26.026603 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-9f2c87fe-7634-4107-b2fa-6e6ce54b949a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:26.034801 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9f2c87fe-7634-4107-b2fa-6e6ce54b949a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7" status: 200 len: 1217 microversion: 2.1 time: 0.064077 Feb 21 01:33:26.045046 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 129/252] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:25 2022] GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7 => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:26.304708 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f91046a4-ba99-4fad-b92f-e5b73c9b1415 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:26.305523 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f91046a4-ba99-4fad-b92f-e5b73c9b1415 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:26.312442 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f91046a4-ba99-4fad-b92f-e5b73c9b1415 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:26.313015 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f91046a4-ba99-4fad-b92f-e5b73c9b1415 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:26.313725 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f91046a4-ba99-4fad-b92f-e5b73c9b1415 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:26.314279 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f91046a4-ba99-4fad-b92f-e5b73c9b1415 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:26.457239 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-f91046a4-ba99-4fad-b92f-e5b73c9b1415 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:26.464646 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f91046a4-ba99-4fad-b92f-e5b73c9b1415 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.163555 Feb 21 01:33:26.465217 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 124/253] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:26 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:27.052380 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c35d401a-c35e-410d-9dcb-a742258be1d3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:27.053050 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c35d401a-c35e-410d-9dcb-a742258be1d3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 41a646dd-0c47-4fe4-8727-3fe9925c80c7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:27.058727 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c35d401a-c35e-410d-9dcb-a742258be1d3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:27.059172 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c35d401a-c35e-410d-9dcb-a742258be1d3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:27.059946 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c35d401a-c35e-410d-9dcb-a742258be1d3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:27.060380 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c35d401a-c35e-410d-9dcb-a742258be1d3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:27.119552 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-c35d401a-c35e-410d-9dcb-a742258be1d3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:27.126661 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c35d401a-c35e-410d-9dcb-a742258be1d3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7" status: 200 len: 1221 microversion: 2.1 time: 0.078107 Feb 21 01:33:27.127220 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 130/254] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:27 2022] GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7 => generated 1221 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:27.481716 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-25ea4d5f-8754-457e-9fb4-959c616d806d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:27.482334 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-25ea4d5f-8754-457e-9fb4-959c616d806d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:27.488766 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25ea4d5f-8754-457e-9fb4-959c616d806d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:27.489224 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25ea4d5f-8754-457e-9fb4-959c616d806d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:27.490007 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25ea4d5f-8754-457e-9fb4-959c616d806d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:27.490444 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25ea4d5f-8754-457e-9fb4-959c616d806d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:27.634947 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-25ea4d5f-8754-457e-9fb4-959c616d806d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:27.642230 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-25ea4d5f-8754-457e-9fb4-959c616d806d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.164115 Feb 21 01:33:27.642812 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 125/255] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:27 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:28.143403 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9b34ae0e-292b-4d19-803d-ddb8e5f744ee tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:28.144020 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9b34ae0e-292b-4d19-803d-ddb8e5f744ee tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 41a646dd-0c47-4fe4-8727-3fe9925c80c7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:28.149714 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b34ae0e-292b-4d19-803d-ddb8e5f744ee tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:28.150172 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b34ae0e-292b-4d19-803d-ddb8e5f744ee tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:28.150982 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b34ae0e-292b-4d19-803d-ddb8e5f744ee tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:28.151411 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9b34ae0e-292b-4d19-803d-ddb8e5f744ee tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:28.217724 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-9b34ae0e-292b-4d19-803d-ddb8e5f744ee tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:28.231491 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9b34ae0e-292b-4d19-803d-ddb8e5f744ee tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7" status: 200 len: 1213 microversion: 2.1 time: 0.085771 Feb 21 01:33:28.231491 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 131/256] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:28 2022] GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:28.659267 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bfb31ce8-5477-45a8-aed0-1de4a6a77e2b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:28.659876 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bfb31ce8-5477-45a8-aed0-1de4a6a77e2b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:28.669444 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfb31ce8-5477-45a8-aed0-1de4a6a77e2b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:28.670235 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfb31ce8-5477-45a8-aed0-1de4a6a77e2b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:28.675229 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfb31ce8-5477-45a8-aed0-1de4a6a77e2b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:28.675229 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bfb31ce8-5477-45a8-aed0-1de4a6a77e2b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:28.811583 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-bfb31ce8-5477-45a8-aed0-1de4a6a77e2b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:28.818899 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bfb31ce8-5477-45a8-aed0-1de4a6a77e2b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.164024 Feb 21 01:33:28.819462 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 126/257] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:28 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:29.246538 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-40bf3dca-c9b7-4b40-85de-0679d741cb81 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:29.247216 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-40bf3dca-c9b7-4b40-85de-0679d741cb81 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 41a646dd-0c47-4fe4-8727-3fe9925c80c7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:29.253133 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40bf3dca-c9b7-4b40-85de-0679d741cb81 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:29.253910 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40bf3dca-c9b7-4b40-85de-0679d741cb81 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:29.254765 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40bf3dca-c9b7-4b40-85de-0679d741cb81 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:29.255406 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40bf3dca-c9b7-4b40-85de-0679d741cb81 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:29.315913 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-40bf3dca-c9b7-4b40-85de-0679d741cb81 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:29.323504 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-40bf3dca-c9b7-4b40-85de-0679d741cb81 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7" status: 200 len: 1213 microversion: 2.1 time: 0.080624 Feb 21 01:33:29.324086 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 132/258] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:29 2022] GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:29.834851 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c42ba027-2087-4887-8a67-88b461e0cc8d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:29.835384 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c42ba027-2087-4887-8a67-88b461e0cc8d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:29.841520 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c42ba027-2087-4887-8a67-88b461e0cc8d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:29.841959 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c42ba027-2087-4887-8a67-88b461e0cc8d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:29.842724 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c42ba027-2087-4887-8a67-88b461e0cc8d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:29.843174 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c42ba027-2087-4887-8a67-88b461e0cc8d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:29.977613 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c42ba027-2087-4887-8a67-88b461e0cc8d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:29.985426 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c42ba027-2087-4887-8a67-88b461e0cc8d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.154312 Feb 21 01:33:29.985996 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 127/259] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:29 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:30.346777 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d515b917-63e8-458a-8a45-bbff7bb4bab4 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:30.349261 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d515b917-63e8-458a-8a45-bbff7bb4bab4 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 41a646dd-0c47-4fe4-8727-3fe9925c80c7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:30.360162 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d515b917-63e8-458a-8a45-bbff7bb4bab4 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:30.360835 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d515b917-63e8-458a-8a45-bbff7bb4bab4 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:30.361606 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d515b917-63e8-458a-8a45-bbff7bb4bab4 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:30.362191 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d515b917-63e8-458a-8a45-bbff7bb4bab4 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:30.457871 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-d515b917-63e8-458a-8a45-bbff7bb4bab4 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:30.465795 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d515b917-63e8-458a-8a45-bbff7bb4bab4 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7" status: 200 len: 1277 microversion: 2.1 time: 0.128455 Feb 21 01:33:30.466718 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 133/260] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:30 2022] GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7 => generated 1277 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:31.002310 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5b3114f4-2617-47d3-bcae-eca165e6bafc tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:31.002923 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5b3114f4-2617-47d3-bcae-eca165e6bafc tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:31.009924 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b3114f4-2617-47d3-bcae-eca165e6bafc tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:31.010591 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b3114f4-2617-47d3-bcae-eca165e6bafc tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:31.011194 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b3114f4-2617-47d3-bcae-eca165e6bafc tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:31.011621 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b3114f4-2617-47d3-bcae-eca165e6bafc tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:31.215937 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-5b3114f4-2617-47d3-bcae-eca165e6bafc tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:31.224119 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5b3114f4-2617-47d3-bcae-eca165e6bafc tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.225576 Feb 21 01:33:31.233614 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 128/261] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:30 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:31.482959 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-61af2d8a-6080-4a98-98ec-5569c16fe580 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:31.484381 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-61af2d8a-6080-4a98-98ec-5569c16fe580 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 41a646dd-0c47-4fe4-8727-3fe9925c80c7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:31.491153 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61af2d8a-6080-4a98-98ec-5569c16fe580 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:31.491736 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61af2d8a-6080-4a98-98ec-5569c16fe580 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:31.492559 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61af2d8a-6080-4a98-98ec-5569c16fe580 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:31.493150 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61af2d8a-6080-4a98-98ec-5569c16fe580 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:31.784945 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-61af2d8a-6080-4a98-98ec-5569c16fe580 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:31.794160 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-61af2d8a-6080-4a98-98ec-5569c16fe580 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7" status: 200 len: 1317 microversion: 2.1 time: 0.314887 Feb 21 01:33:31.806240 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 134/262] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:31 2022] GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7 => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:32.141551 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-e0788dfc-43e3-420b-b0f1-c64137ef2b0d req-96f41210-b272-407c-af4b-d4fa5b1e0ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41a646dd-0c47-4fe4-8727-3fe9925c80c7", "tag": "08712441-0ce7-4bec-af4d-4a2f88e466db"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:33:32.143246 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:33:32.143246 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:33:32.151430 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e0788dfc-43e3-420b-b0f1-c64137ef2b0d req-96f41210-b272-407c-af4b-d4fa5b1e0ca7 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:32.151883 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e0788dfc-43e3-420b-b0f1-c64137ef2b0d req-96f41210-b272-407c-af4b-d4fa5b1e0ca7 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:32.164273 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-e0788dfc-43e3-420b-b0f1-c64137ef2b0d req-96f41210-b272-407c-af4b-d4fa5b1e0ca7 service nova] Creating event network-changed:08712441-0ce7-4bec-af4d-4a2f88e466db for instance 41a646dd-0c47-4fe4-8727-3fe9925c80c7 on hv-cinder-81322 Feb 21 01:33:32.169744 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-e0788dfc-43e3-420b-b0f1-c64137ef2b0d req-96f41210-b272-407c-af4b-d4fa5b1e0ca7 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032787 Feb 21 01:33:32.170592 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 129/263] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:33:32.240891 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c5b566d8-9ffd-4070-8135-a507f3ca146a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:32.241491 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c5b566d8-9ffd-4070-8135-a507f3ca146a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:32.247131 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5b566d8-9ffd-4070-8135-a507f3ca146a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:32.247567 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5b566d8-9ffd-4070-8135-a507f3ca146a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:32.248400 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5b566d8-9ffd-4070-8135-a507f3ca146a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:32.248885 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c5b566d8-9ffd-4070-8135-a507f3ca146a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:32.544077 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-c5b566d8-9ffd-4070-8135-a507f3ca146a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:32.553349 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c5b566d8-9ffd-4070-8135-a507f3ca146a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.315930 Feb 21 01:33:32.558146 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 135/264] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:32 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:32.813071 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-58b5680e-6508-4c98-b874-49528e282a6f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:32.813778 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-58b5680e-6508-4c98-b874-49528e282a6f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 41a646dd-0c47-4fe4-8727-3fe9925c80c7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:32.825164 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58b5680e-6508-4c98-b874-49528e282a6f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:32.825941 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58b5680e-6508-4c98-b874-49528e282a6f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:32.828552 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58b5680e-6508-4c98-b874-49528e282a6f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:32.828721 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-58b5680e-6508-4c98-b874-49528e282a6f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:33.005147 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3547e933-72e2-43a2-bd1a-b6a75945384f tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:33.006001 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3547e933-72e2-43a2-bd1a-b6a75945384f tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:33.014285 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3547e933-72e2-43a2-bd1a-b6a75945384f tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:33.014814 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3547e933-72e2-43a2-bd1a-b6a75945384f tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:33.016125 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3547e933-72e2-43a2-bd1a-b6a75945384f tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:33.016789 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3547e933-72e2-43a2-bd1a-b6a75945384f tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:33.044385 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3547e933-72e2-43a2-bd1a-b6a75945384f tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:33:33.108531 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-58b5680e-6508-4c98-b874-49528e282a6f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:33.116144 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-58b5680e-6508-4c98-b874-49528e282a6f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7" status: 200 len: 1317 microversion: 2.1 time: 0.307603 Feb 21 01:33:33.116738 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 130/265] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:32 2022] GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7 => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:33.327625 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3547e933-72e2-43a2-bd1a-b6a75945384f tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "DELETE /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 204 len: 0 microversion: 2.1 time: 0.326372 Feb 21 01:33:33.329925 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 136/266] 10.222.0.90 () {58 vars in 1238 bytes} [Mon Feb 21 01:33:32 2022] DELETE /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:33:33.341746 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-651e8bea-f760-4cd2-b4e9-958aff4d9b8d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:33.342362 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-651e8bea-f760-4cd2-b4e9-958aff4d9b8d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:33.348774 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-651e8bea-f760-4cd2-b4e9-958aff4d9b8d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:33.349418 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-651e8bea-f760-4cd2-b4e9-958aff4d9b8d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:33.350205 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-651e8bea-f760-4cd2-b4e9-958aff4d9b8d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:33.350636 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-651e8bea-f760-4cd2-b4e9-958aff4d9b8d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:33.527434 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-651e8bea-f760-4cd2-b4e9-958aff4d9b8d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:33.537645 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-651e8bea-f760-4cd2-b4e9-958aff4d9b8d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1553 microversion: 2.1 time: 0.199390 Feb 21 01:33:33.538459 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 131/267] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:33 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1553 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:33.574268 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d1bda3cb-df58-434f-84a7-8f7127a18697 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:33.574976 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d1bda3cb-df58-434f-84a7-8f7127a18697 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:33.581383 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1bda3cb-df58-434f-84a7-8f7127a18697 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:33.582028 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1bda3cb-df58-434f-84a7-8f7127a18697 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:33.582794 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1bda3cb-df58-434f-84a7-8f7127a18697 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:33.583424 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1bda3cb-df58-434f-84a7-8f7127a18697 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:33.734721 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-d1bda3cb-df58-434f-84a7-8f7127a18697 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:33.744860 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d1bda3cb-df58-434f-84a7-8f7127a18697 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.174778 Feb 21 01:33:33.747613 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 137/268] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:33 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:34.133689 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0f066fe5-3673-4b5f-a1a9-37c755b7dcb5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:34.134344 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0f066fe5-3673-4b5f-a1a9-37c755b7dcb5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 41a646dd-0c47-4fe4-8727-3fe9925c80c7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:34.140177 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f066fe5-3673-4b5f-a1a9-37c755b7dcb5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:34.140673 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f066fe5-3673-4b5f-a1a9-37c755b7dcb5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:34.141451 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f066fe5-3673-4b5f-a1a9-37c755b7dcb5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:34.141887 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0f066fe5-3673-4b5f-a1a9-37c755b7dcb5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:34.347251 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-0f066fe5-3673-4b5f-a1a9-37c755b7dcb5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:34.355542 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0f066fe5-3673-4b5f-a1a9-37c755b7dcb5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7" status: 200 len: 1317 microversion: 2.1 time: 0.225763 Feb 21 01:33:34.356390 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 132/269] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:34 2022] GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:34.558035 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cd003782-a320-4721-8127-202738e67dd8 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:34.558864 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cd003782-a320-4721-8127-202738e67dd8 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:34.569593 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd003782-a320-4721-8127-202738e67dd8 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:34.570038 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd003782-a320-4721-8127-202738e67dd8 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:34.570815 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd003782-a320-4721-8127-202738e67dd8 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:34.571262 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd003782-a320-4721-8127-202738e67dd8 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:34.766166 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d050537f-e503-40a2-aac0-6332ac5b6f03 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:34.766166 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d050537f-e503-40a2-aac0-6332ac5b6f03 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:34.771174 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d050537f-e503-40a2-aac0-6332ac5b6f03 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:34.771626 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d050537f-e503-40a2-aac0-6332ac5b6f03 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:34.772442 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d050537f-e503-40a2-aac0-6332ac5b6f03 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:34.772884 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d050537f-e503-40a2-aac0-6332ac5b6f03 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:34.994304 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-cd003782-a320-4721-8127-202738e67dd8 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:35.004457 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cd003782-a320-4721-8127-202738e67dd8 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1553 microversion: 2.1 time: 0.452342 Feb 21 01:33:35.012908 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 138/270] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:34 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1553 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:35.071459 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-d050537f-e503-40a2-aac0-6332ac5b6f03 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:35.079624 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d050537f-e503-40a2-aac0-6332ac5b6f03 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.318890 Feb 21 01:33:35.080190 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 133/271] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:34 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:33:35.373120 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-994f0aac-014d-431a-a0ae-b99e36d93925 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:35.373727 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-994f0aac-014d-431a-a0ae-b99e36d93925 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 41a646dd-0c47-4fe4-8727-3fe9925c80c7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:35.379552 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-994f0aac-014d-431a-a0ae-b99e36d93925 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:35.380002 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-994f0aac-014d-431a-a0ae-b99e36d93925 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:35.380865 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-994f0aac-014d-431a-a0ae-b99e36d93925 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:35.381301 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-994f0aac-014d-431a-a0ae-b99e36d93925 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:35.519752 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-994f0aac-014d-431a-a0ae-b99e36d93925 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:35.526997 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-994f0aac-014d-431a-a0ae-b99e36d93925 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7" status: 200 len: 1317 microversion: 2.1 time: 0.157634 Feb 21 01:33:35.527564 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 139/272] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:35 2022] GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:36.022805 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a5bcb7c9-2b73-411b-9c3e-19d8207f0269 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:36.023417 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a5bcb7c9-2b73-411b-9c3e-19d8207f0269 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:36.029799 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5bcb7c9-2b73-411b-9c3e-19d8207f0269 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:36.030255 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5bcb7c9-2b73-411b-9c3e-19d8207f0269 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:36.031274 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5bcb7c9-2b73-411b-9c3e-19d8207f0269 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:36.031713 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5bcb7c9-2b73-411b-9c3e-19d8207f0269 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:36.102139 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b130fccd-2e98-437c-8667-129d23b5e072 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:36.108310 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b130fccd-2e98-437c-8667-129d23b5e072 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:36.109767 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b130fccd-2e98-437c-8667-129d23b5e072 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:36.110210 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b130fccd-2e98-437c-8667-129d23b5e072 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:36.110980 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b130fccd-2e98-437c-8667-129d23b5e072 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:36.111411 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b130fccd-2e98-437c-8667-129d23b5e072 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:36.206996 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-a5bcb7c9-2b73-411b-9c3e-19d8207f0269 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:36.220584 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a5bcb7c9-2b73-411b-9c3e-19d8207f0269 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1553 microversion: 2.1 time: 0.201361 Feb 21 01:33:36.227973 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 134/273] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:36 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1553 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:36.294882 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b130fccd-2e98-437c-8667-129d23b5e072 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:36.303035 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b130fccd-2e98-437c-8667-129d23b5e072 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.204646 Feb 21 01:33:36.303691 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 140/274] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:36 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:33:36.543156 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8b8d9538-1194-4dcc-8477-9b5bd60610a5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:36.543775 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8b8d9538-1194-4dcc-8477-9b5bd60610a5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 41a646dd-0c47-4fe4-8727-3fe9925c80c7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:36.555766 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b8d9538-1194-4dcc-8477-9b5bd60610a5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:36.556211 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b8d9538-1194-4dcc-8477-9b5bd60610a5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:36.557035 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b8d9538-1194-4dcc-8477-9b5bd60610a5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:36.557473 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8b8d9538-1194-4dcc-8477-9b5bd60610a5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:36.702943 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-8b8d9538-1194-4dcc-8477-9b5bd60610a5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:36.710387 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8b8d9538-1194-4dcc-8477-9b5bd60610a5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7" status: 200 len: 1317 microversion: 2.1 time: 0.170969 Feb 21 01:33:36.710980 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 135/275] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:36 2022] GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:37.238924 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2739ef37-6632-479c-85cf-d968c7f7529e tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:37.240060 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2739ef37-6632-479c-85cf-d968c7f7529e tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:37.245958 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2739ef37-6632-479c-85cf-d968c7f7529e tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:37.246409 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2739ef37-6632-479c-85cf-d968c7f7529e tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:37.247196 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2739ef37-6632-479c-85cf-d968c7f7529e tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:37.247631 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2739ef37-6632-479c-85cf-d968c7f7529e tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:37.320640 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b4c00a80-5805-4c6d-baf1-130f54af69ac tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:37.324602 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b4c00a80-5805-4c6d-baf1-130f54af69ac tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:37.327911 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4c00a80-5805-4c6d-baf1-130f54af69ac tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:37.328993 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4c00a80-5805-4c6d-baf1-130f54af69ac tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:37.330074 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4c00a80-5805-4c6d-baf1-130f54af69ac tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:37.330612 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b4c00a80-5805-4c6d-baf1-130f54af69ac tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:37.421488 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2739ef37-6632-479c-85cf-d968c7f7529e tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:37.451996 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2739ef37-6632-479c-85cf-d968c7f7529e tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1553 microversion: 2.1 time: 0.217358 Feb 21 01:33:37.453721 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 141/276] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:37 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1553 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:37.550468 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-b4c00a80-5805-4c6d-baf1-130f54af69ac tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:37.558476 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b4c00a80-5805-4c6d-baf1-130f54af69ac tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.242314 Feb 21 01:33:37.558979 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 136/277] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:37 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:33:37.726836 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a28f6eba-5ccc-437f-8cde-fe6cf902a8ca tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:37.727588 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a28f6eba-5ccc-437f-8cde-fe6cf902a8ca tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 41a646dd-0c47-4fe4-8727-3fe9925c80c7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:37.733553 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a28f6eba-5ccc-437f-8cde-fe6cf902a8ca tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:37.733991 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a28f6eba-5ccc-437f-8cde-fe6cf902a8ca tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:37.734752 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a28f6eba-5ccc-437f-8cde-fe6cf902a8ca tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:37.735173 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a28f6eba-5ccc-437f-8cde-fe6cf902a8ca tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:37.998462 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-a28f6eba-5ccc-437f-8cde-fe6cf902a8ca tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:38.007027 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a28f6eba-5ccc-437f-8cde-fe6cf902a8ca tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7" status: 200 len: 1317 microversion: 2.1 time: 0.283834 Feb 21 01:33:38.007605 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 142/278] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:37 2022] GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7 => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:38.417498 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-060543b8-355d-4e53-98bc-1fedc73b4405 req-e1cd921d-f331-4058-b305-0b8200e70d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d359b725-8ebc-4c70-b60b-fac888f539dc", "name": "network-vif-deleted", "tag": "29ef37bc-fe8f-48e8-8a21-00801ca04b5a"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:33:38.423980 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:33:38.423980 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:33:38.426784 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-060543b8-355d-4e53-98bc-1fedc73b4405 req-e1cd921d-f331-4058-b305-0b8200e70d6a service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:38.427233 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-060543b8-355d-4e53-98bc-1fedc73b4405 req-e1cd921d-f331-4058-b305-0b8200e70d6a service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:38.438338 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-060543b8-355d-4e53-98bc-1fedc73b4405 req-e1cd921d-f331-4058-b305-0b8200e70d6a service nova] Creating event network-vif-deleted:29ef37bc-fe8f-48e8-8a21-00801ca04b5a for instance d359b725-8ebc-4c70-b60b-fac888f539dc on hv-cinder-81322 Feb 21 01:33:38.443313 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-060543b8-355d-4e53-98bc-1fedc73b4405 req-e1cd921d-f331-4058-b305-0b8200e70d6a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029456 Feb 21 01:33:38.443932 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 137/279] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:33:38.473458 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9e3a0986-72a9-491c-9372-b74521e82ad5 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:38.474077 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9e3a0986-72a9-491c-9372-b74521e82ad5 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:38.480607 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e3a0986-72a9-491c-9372-b74521e82ad5 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:38.481059 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e3a0986-72a9-491c-9372-b74521e82ad5 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:38.481844 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e3a0986-72a9-491c-9372-b74521e82ad5 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:38.482281 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9e3a0986-72a9-491c-9372-b74521e82ad5 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:38.550474 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-9e3a0986-72a9-491c-9372-b74521e82ad5 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:38.564398 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9e3a0986-72a9-491c-9372-b74521e82ad5 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1511 microversion: 2.1 time: 0.093055 Feb 21 01:33:38.564398 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 143/280] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:38 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1511 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:38.576164 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b2563f91-5fe8-4571-836a-b28e495c3a0e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:38.576896 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b2563f91-5fe8-4571-836a-b28e495c3a0e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:38.582926 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2563f91-5fe8-4571-836a-b28e495c3a0e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:38.583378 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2563f91-5fe8-4571-836a-b28e495c3a0e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:38.584335 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2563f91-5fe8-4571-836a-b28e495c3a0e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:38.584802 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b2563f91-5fe8-4571-836a-b28e495c3a0e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:38.723671 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-b2563f91-5fe8-4571-836a-b28e495c3a0e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:38.731166 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b2563f91-5fe8-4571-836a-b28e495c3a0e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.159225 Feb 21 01:33:38.732058 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 138/281] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:38 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:33:39.024552 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4979a57c-580b-4730-a574-b7f76dfa978e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:39.025184 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4979a57c-580b-4730-a574-b7f76dfa978e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 41a646dd-0c47-4fe4-8727-3fe9925c80c7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:39.030906 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4979a57c-580b-4730-a574-b7f76dfa978e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:39.031359 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4979a57c-580b-4730-a574-b7f76dfa978e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:39.032147 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4979a57c-580b-4730-a574-b7f76dfa978e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:39.033656 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4979a57c-580b-4730-a574-b7f76dfa978e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:39.235400 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-4979a57c-580b-4730-a574-b7f76dfa978e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:39.249429 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4979a57c-580b-4730-a574-b7f76dfa978e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7" status: 200 len: 1317 microversion: 2.1 time: 0.228328 Feb 21 01:33:39.250011 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 144/282] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:39 2022] GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7 => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:39.578819 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-904fb506-56c4-47d8-b2dc-988aa092445d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:39.579517 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-904fb506-56c4-47d8-b2dc-988aa092445d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:39.589806 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-904fb506-56c4-47d8-b2dc-988aa092445d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:39.590263 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-904fb506-56c4-47d8-b2dc-988aa092445d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:39.591070 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-904fb506-56c4-47d8-b2dc-988aa092445d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:39.591497 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-904fb506-56c4-47d8-b2dc-988aa092445d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:39.641859 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-904fb506-56c4-47d8-b2dc-988aa092445d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:39.642311 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-904fb506-56c4-47d8-b2dc-988aa092445d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:39.642769 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-904fb506-56c4-47d8-b2dc-988aa092445d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lazy-loading 'fault' on Instance uuid d359b725-8ebc-4c70-b60b-fac888f539dc {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:33:39.686066 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-904fb506-56c4-47d8-b2dc-988aa092445d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210676a641554f6e816dda2a7717cbc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fb11bd56f946d1a12bb7aba48aece1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:39.695029 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-904fb506-56c4-47d8-b2dc-988aa092445d tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 200 len: 1350 microversion: 2.1 time: 0.120020 Feb 21 01:33:39.695603 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 139/283] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:39 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 1350 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:39.748805 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-61c6de9c-d336-4d6f-8c39-4e83ea2cf278 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:39.749446 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-61c6de9c-d336-4d6f-8c39-4e83ea2cf278 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:39.756648 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61c6de9c-d336-4d6f-8c39-4e83ea2cf278 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:39.757169 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61c6de9c-d336-4d6f-8c39-4e83ea2cf278 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:39.758341 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61c6de9c-d336-4d6f-8c39-4e83ea2cf278 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:39.758921 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61c6de9c-d336-4d6f-8c39-4e83ea2cf278 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:39.896785 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-61c6de9c-d336-4d6f-8c39-4e83ea2cf278 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:39.904553 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-61c6de9c-d336-4d6f-8c39-4e83ea2cf278 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.159330 Feb 21 01:33:39.905146 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 145/284] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:39 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:33:40.267483 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-48d8f71f-3165-40bd-b6e1-7084b074eda3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:40.268038 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-48d8f71f-3165-40bd-b6e1-7084b074eda3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 41a646dd-0c47-4fe4-8727-3fe9925c80c7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:40.274519 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48d8f71f-3165-40bd-b6e1-7084b074eda3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:40.275100 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48d8f71f-3165-40bd-b6e1-7084b074eda3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:40.276023 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48d8f71f-3165-40bd-b6e1-7084b074eda3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:40.276690 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-48d8f71f-3165-40bd-b6e1-7084b074eda3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:40.445585 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-48d8f71f-3165-40bd-b6e1-7084b074eda3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:40.452934 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-48d8f71f-3165-40bd-b6e1-7084b074eda3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7" status: 200 len: 1317 microversion: 2.1 time: 0.189739 Feb 21 01:33:40.453515 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 140/285] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:40 2022] GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7 => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:40.712265 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-69de6777-f163-43ad-853f-5c7aa980c46e tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:40.712943 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-69de6777-f163-43ad-853f-5c7aa980c46e tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:40.719032 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-69de6777-f163-43ad-853f-5c7aa980c46e tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:40.719485 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-69de6777-f163-43ad-853f-5c7aa980c46e tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:40.720268 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-69de6777-f163-43ad-853f-5c7aa980c46e tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:40.720727 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-69de6777-f163-43ad-853f-5c7aa980c46e tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:40.734051 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-69de6777-f163-43ad-853f-5c7aa980c46e tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] HTTP exception thrown: Instance d359b725-8ebc-4c70-b60b-fac888f539dc could not be found. Feb 21 01:33:40.734638 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-69de6777-f163-43ad-853f-5c7aa980c46e tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Returning 404 to user: Instance d359b725-8ebc-4c70-b60b-fac888f539dc could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:33:40.735457 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-69de6777-f163-43ad-853f-5c7aa980c46e tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 404 len: 111 microversion: 2.1 time: 0.026846 Feb 21 01:33:40.736007 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 146/286] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:40 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:33:40.842044 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ccec3499-cabc-4bef-b9fb-cae715296fcb tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:40.842993 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ccec3499-cabc-4bef-b9fb-cae715296fcb tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:40.849225 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ccec3499-cabc-4bef-b9fb-cae715296fcb tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:40.849673 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ccec3499-cabc-4bef-b9fb-cae715296fcb tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:40.850446 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ccec3499-cabc-4bef-b9fb-cae715296fcb tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:40.850880 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ccec3499-cabc-4bef-b9fb-cae715296fcb tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:40.864048 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-ccec3499-cabc-4bef-b9fb-cae715296fcb tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] HTTP exception thrown: Instance d359b725-8ebc-4c70-b60b-fac888f539dc could not be found. Feb 21 01:33:40.864671 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ccec3499-cabc-4bef-b9fb-cae715296fcb tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Returning 404 to user: Instance d359b725-8ebc-4c70-b60b-fac888f539dc could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:33:40.865490 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ccec3499-cabc-4bef-b9fb-cae715296fcb tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.027310 Feb 21 01:33:40.866041 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 141/287] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:33:40 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc/os-volume_attachments => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:33:40.925234 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b1e7fd6d-44af-4c3a-ba3c-9199abd9f07a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:40.925234 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b1e7fd6d-44af-4c3a-ba3c-9199abd9f07a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:40.927833 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b1e7fd6d-44af-4c3a-ba3c-9199abd9f07a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:40.928292 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b1e7fd6d-44af-4c3a-ba3c-9199abd9f07a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:40.929097 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b1e7fd6d-44af-4c3a-ba3c-9199abd9f07a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:40.929559 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b1e7fd6d-44af-4c3a-ba3c-9199abd9f07a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:41.074388 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b1e7fd6d-44af-4c3a-ba3c-9199abd9f07a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:41.082009 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b1e7fd6d-44af-4c3a-ba3c-9199abd9f07a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.164557 Feb 21 01:33:41.082630 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 147/288] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:40 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:41.365877 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-954fba4b-7102-4471-a773-6a7d75058db4 req-df694d0b-0795-4966-acc0-276a392ce9a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41a646dd-0c47-4fe4-8727-3fe9925c80c7", "name": "network-vif-plugged", "status": "completed", "tag": "08712441-0ce7-4bec-af4d-4a2f88e466db"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:33:41.367648 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:33:41.367648 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:33:41.375739 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-954fba4b-7102-4471-a773-6a7d75058db4 req-df694d0b-0795-4966-acc0-276a392ce9a6 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:41.375739 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-954fba4b-7102-4471-a773-6a7d75058db4 req-df694d0b-0795-4966-acc0-276a392ce9a6 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:41.386895 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-954fba4b-7102-4471-a773-6a7d75058db4 req-df694d0b-0795-4966-acc0-276a392ce9a6 service nova] Creating event network-vif-plugged:08712441-0ce7-4bec-af4d-4a2f88e466db for instance 41a646dd-0c47-4fe4-8727-3fe9925c80c7 on hv-cinder-81322 Feb 21 01:33:41.391766 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-954fba4b-7102-4471-a773-6a7d75058db4 req-df694d0b-0795-4966-acc0-276a392ce9a6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029712 Feb 21 01:33:41.392353 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 142/289] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:33:41.469610 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-06c46443-465c-42f5-8d16-4a6df4d53aac tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:41.470842 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-06c46443-465c-42f5-8d16-4a6df4d53aac tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 41a646dd-0c47-4fe4-8727-3fe9925c80c7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:41.476921 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06c46443-465c-42f5-8d16-4a6df4d53aac tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:41.477371 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06c46443-465c-42f5-8d16-4a6df4d53aac tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:41.478389 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06c46443-465c-42f5-8d16-4a6df4d53aac tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:41.478824 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06c46443-465c-42f5-8d16-4a6df4d53aac tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:41.646747 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-06c46443-465c-42f5-8d16-4a6df4d53aac tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:41.654308 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-06c46443-465c-42f5-8d16-4a6df4d53aac tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7" status: 200 len: 1317 microversion: 2.1 time: 0.188586 Feb 21 01:33:41.654885 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 148/290] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:41 2022] GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:42.101069 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-75c2d7c8-ba5f-4f09-a898-5a33feedd67a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:42.101929 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-75c2d7c8-ba5f-4f09-a898-5a33feedd67a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:42.108231 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75c2d7c8-ba5f-4f09-a898-5a33feedd67a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:42.108718 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75c2d7c8-ba5f-4f09-a898-5a33feedd67a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:42.109571 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75c2d7c8-ba5f-4f09-a898-5a33feedd67a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:42.110009 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-75c2d7c8-ba5f-4f09-a898-5a33feedd67a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:42.187098 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-863c0d71-91be-4346-9b62-d178164a77bd tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:42.187593 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-863c0d71-91be-4346-9b62-d178164a77bd tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:42.194757 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-863c0d71-91be-4346-9b62-d178164a77bd tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:42.195202 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-863c0d71-91be-4346-9b62-d178164a77bd tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:42.196088 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-863c0d71-91be-4346-9b62-d178164a77bd tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:42.196412 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-863c0d71-91be-4346-9b62-d178164a77bd tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:42.211738 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-863c0d71-91be-4346-9b62-d178164a77bd tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] HTTP exception thrown: Instance d359b725-8ebc-4c70-b60b-fac888f539dc could not be found. Feb 21 01:33:42.212332 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-863c0d71-91be-4346-9b62-d178164a77bd tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Returning 404 to user: Instance d359b725-8ebc-4c70-b60b-fac888f539dc could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:33:42.213313 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-863c0d71-91be-4346-9b62-d178164a77bd tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "DELETE /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 404 len: 111 microversion: 2.1 time: 0.029835 Feb 21 01:33:42.213807 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 149/291] 10.222.0.90 () {58 vars in 1238 bytes} [Mon Feb 21 01:33:42 2022] DELETE /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:33:42.221429 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0a66a0bd-6106-437c-96a9-2e2e88d1a5e8 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:42.222035 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0a66a0bd-6106-437c-96a9-2e2e88d1a5e8 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] [instance: d359b725-8ebc-4c70-b60b-fac888f539dc] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:42.227840 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a66a0bd-6106-437c-96a9-2e2e88d1a5e8 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:42.228284 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a66a0bd-6106-437c-96a9-2e2e88d1a5e8 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:42.229078 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a66a0bd-6106-437c-96a9-2e2e88d1a5e8 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:42.229498 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a66a0bd-6106-437c-96a9-2e2e88d1a5e8 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:42.243922 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-0a66a0bd-6106-437c-96a9-2e2e88d1a5e8 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] HTTP exception thrown: Instance d359b725-8ebc-4c70-b60b-fac888f539dc could not be found. Feb 21 01:33:42.244564 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0a66a0bd-6106-437c-96a9-2e2e88d1a5e8 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] Returning 404 to user: Instance d359b725-8ebc-4c70-b60b-fac888f539dc could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:33:42.245381 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0a66a0bd-6106-437c-96a9-2e2e88d1a5e8 tempest-DeleteServersTestJSON-1098657558 tempest-DeleteServersTestJSON-1098657558-project] 10.222.0.90 "GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc" status: 404 len: 111 microversion: 2.1 time: 0.027468 Feb 21 01:33:42.245946 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 150/292] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:42 2022] GET /compute/v2.1/servers/d359b725-8ebc-4c70-b60b-fac888f539dc => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 21 01:33:42.281253 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-75c2d7c8-ba5f-4f09-a898-5a33feedd67a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:42.288491 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-75c2d7c8-ba5f-4f09-a898-5a33feedd67a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.191859 Feb 21 01:33:42.297736 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 143/293] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:42 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:42.670957 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-87037f8a-86ce-4a00-9b2c-2f30262b2f7c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:42.671913 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-87037f8a-86ce-4a00-9b2c-2f30262b2f7c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 41a646dd-0c47-4fe4-8727-3fe9925c80c7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:42.679349 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87037f8a-86ce-4a00-9b2c-2f30262b2f7c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:42.679876 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87037f8a-86ce-4a00-9b2c-2f30262b2f7c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:42.680766 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87037f8a-86ce-4a00-9b2c-2f30262b2f7c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:42.681294 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87037f8a-86ce-4a00-9b2c-2f30262b2f7c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:42.823104 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-87037f8a-86ce-4a00-9b2c-2f30262b2f7c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:42.830449 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-87037f8a-86ce-4a00-9b2c-2f30262b2f7c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7" status: 200 len: 1317 microversion: 2.1 time: 0.163196 Feb 21 01:33:42.831002 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 151/294] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:42 2022] GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:43.304982 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-30c5be77-b885-4a2d-a5cc-9c210fb3c9c6 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:43.305518 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-30c5be77-b885-4a2d-a5cc-9c210fb3c9c6 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:43.311942 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30c5be77-b885-4a2d-a5cc-9c210fb3c9c6 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:43.312398 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30c5be77-b885-4a2d-a5cc-9c210fb3c9c6 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:43.313206 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30c5be77-b885-4a2d-a5cc-9c210fb3c9c6 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:43.313641 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-30c5be77-b885-4a2d-a5cc-9c210fb3c9c6 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:43.489359 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-30c5be77-b885-4a2d-a5cc-9c210fb3c9c6 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:43.496489 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-30c5be77-b885-4a2d-a5cc-9c210fb3c9c6 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.195282 Feb 21 01:33:43.497237 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 144/295] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:43 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:43.847182 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a2d755d1-8fa8-4f37-9e8e-dd67814e98a5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:43.847784 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a2d755d1-8fa8-4f37-9e8e-dd67814e98a5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 41a646dd-0c47-4fe4-8727-3fe9925c80c7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:43.853652 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2d755d1-8fa8-4f37-9e8e-dd67814e98a5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:43.854117 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2d755d1-8fa8-4f37-9e8e-dd67814e98a5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:43.854892 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2d755d1-8fa8-4f37-9e8e-dd67814e98a5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:43.855357 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2d755d1-8fa8-4f37-9e8e-dd67814e98a5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:43.988074 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-a2d755d1-8fa8-4f37-9e8e-dd67814e98a5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:43.995294 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a2d755d1-8fa8-4f37-9e8e-dd67814e98a5 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7" status: 200 len: 1507 microversion: 2.1 time: 0.151676 Feb 21 01:33:44.000510 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 152/296] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:43 2022] GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:44.013622 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7a89f936-fc47-44b4-a12d-74b5b3e5022e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3342dd83-9294-4ece-be20-e74cb7e16c6d"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:33:44.015169 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7a89f936-fc47-44b4-a12d-74b5b3e5022e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 41a646dd-0c47-4fe4-8727-3fe9925c80c7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:44.021253 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a89f936-fc47-44b4-a12d-74b5b3e5022e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:44.021698 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a89f936-fc47-44b4-a12d-74b5b3e5022e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:44.022641 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a89f936-fc47-44b4-a12d-74b5b3e5022e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:44.023080 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7a89f936-fc47-44b4-a12d-74b5b3e5022e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:44.100670 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-7a89f936-fc47-44b4-a12d-74b5b3e5022e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] HTTP exception thrown: Invalid volume: volume 3342dd83-9294-4ece-be20-e74cb7e16c6d is already attached to instances: 58d88f85-1d15-4f12-a8e7-f3b531088d5e Feb 21 01:33:44.101273 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7a89f936-fc47-44b4-a12d-74b5b3e5022e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Returning 400 to user: Invalid volume: volume 3342dd83-9294-4ece-be20-e74cb7e16c6d is already attached to instances: 58d88f85-1d15-4f12-a8e7-f3b531088d5e {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:33:44.102154 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7a89f936-fc47-44b4-a12d-74b5b3e5022e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "POST /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092685 Feb 21 01:33:44.102707 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 145/297] 10.222.0.90 () {60 vars in 1322 bytes} [Mon Feb 21 01:33:44 2022] POST /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:33:44.164768 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fd450382-c605-4a26-85c6-992fb061c885 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:44.165265 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fd450382-c605-4a26-85c6-992fb061c885 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:44.173533 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd450382-c605-4a26-85c6-992fb061c885 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:44.173533 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd450382-c605-4a26-85c6-992fb061c885 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:44.173533 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd450382-c605-4a26-85c6-992fb061c885 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:44.173533 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd450382-c605-4a26-85c6-992fb061c885 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:44.298172 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-fd450382-c605-4a26-85c6-992fb061c885 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lazy-loading 'services' on Instance uuid 58d88f85-1d15-4f12-a8e7-f3b531088d5e {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:33:44.504906 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fd450382-c605-4a26-85c6-992fb061c885 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "DELETE /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e/os-volume_attachments/3342dd83-9294-4ece-be20-e74cb7e16c6d" status: 202 len: 0 microversion: 2.1 time: 0.343531 Feb 21 01:33:44.505560 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 153/298] 10.222.0.90 () {58 vars in 1415 bytes} [Mon Feb 21 01:33:44 2022] DELETE /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e/os-volume_attachments/3342dd83-9294-4ece-be20-e74cb7e16c6d => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:33:44.513736 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ffa9d0e4-077c-480d-b625-4fc0526864a1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:44.514356 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ffa9d0e4-077c-480d-b625-4fc0526864a1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:44.519959 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a7b768ad-2616-41ce-b9aa-371b06ed75b6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:44.521264 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a7b768ad-2616-41ce-b9aa-371b06ed75b6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:44.521591 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ffa9d0e4-077c-480d-b625-4fc0526864a1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:44.522046 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ffa9d0e4-077c-480d-b625-4fc0526864a1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:44.522878 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ffa9d0e4-077c-480d-b625-4fc0526864a1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:44.523313 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ffa9d0e4-077c-480d-b625-4fc0526864a1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:44.533853 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7b768ad-2616-41ce-b9aa-371b06ed75b6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:44.533853 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7b768ad-2616-41ce-b9aa-371b06ed75b6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:44.533853 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7b768ad-2616-41ce-b9aa-371b06ed75b6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:44.533853 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7b768ad-2616-41ce-b9aa-371b06ed75b6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:44.564210 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a7b768ad-2616-41ce-b9aa-371b06ed75b6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049320 Feb 21 01:33:44.565103 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 154/299] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:33:44 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:33:44.668486 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ffa9d0e4-077c-480d-b625-4fc0526864a1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:44.680529 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ffa9d0e4-077c-480d-b625-4fc0526864a1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.171432 Feb 21 01:33:44.681755 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 146/300] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:44 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:45.574847 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3e8cf272-05fa-431b-9687-ac652d6156bc tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:45.575768 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3e8cf272-05fa-431b-9687-ac652d6156bc tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:45.581959 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e8cf272-05fa-431b-9687-ac652d6156bc tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:45.582399 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e8cf272-05fa-431b-9687-ac652d6156bc tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:45.583166 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e8cf272-05fa-431b-9687-ac652d6156bc tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:45.583596 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e8cf272-05fa-431b-9687-ac652d6156bc tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:45.612811 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3e8cf272-05fa-431b-9687-ac652d6156bc tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041611 Feb 21 01:33:45.613382 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 155/301] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:33:45 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:33:45.701447 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9a5cfe8c-a5cb-4152-b29e-5fce1ce79afb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:45.703648 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9a5cfe8c-a5cb-4152-b29e-5fce1ce79afb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:45.725247 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a5cfe8c-a5cb-4152-b29e-5fce1ce79afb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:45.726062 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a5cfe8c-a5cb-4152-b29e-5fce1ce79afb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:45.727442 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a5cfe8c-a5cb-4152-b29e-5fce1ce79afb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:45.728282 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9a5cfe8c-a5cb-4152-b29e-5fce1ce79afb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:45.905870 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-9a5cfe8c-a5cb-4152-b29e-5fce1ce79afb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:45.914979 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9a5cfe8c-a5cb-4152-b29e-5fce1ce79afb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.220644 Feb 21 01:33:45.915556 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 147/302] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:45 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:46.624087 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0de4f286-8a32-46eb-a711-5a2464b2d24b tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:46.625035 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0de4f286-8a32-46eb-a711-5a2464b2d24b tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:46.631201 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0de4f286-8a32-46eb-a711-5a2464b2d24b tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:46.631640 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0de4f286-8a32-46eb-a711-5a2464b2d24b tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:46.632394 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0de4f286-8a32-46eb-a711-5a2464b2d24b tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:46.633108 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0de4f286-8a32-46eb-a711-5a2464b2d24b tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:46.666000 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0de4f286-8a32-46eb-a711-5a2464b2d24b tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045706 Feb 21 01:33:46.666550 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 156/303] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:33:46 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 01:33:46.826364 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-29e3a7bd-010c-4339-b1bd-0ffbff1057eb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-165281462", "imageRef": "35936a71-5ec3-4154-b01a-f2dafd8c0364", "flavorRef": "452", "networks": [{"uuid": "19c3a3ee-4943-4cb3-b92f-e4a4ed0d979a"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:33:46.878115 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-29e3a7bd-010c-4339-b1bd-0ffbff1057eb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] validate_networks() for [('19c3a3ee-4943-4cb3-b92f-e4a4ed0d979a', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:33:46.931345 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e537d179-125b-4d00-b431-1aa3795ce1da tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:46.932019 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e537d179-125b-4d00-b431-1aa3795ce1da tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:46.938959 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e537d179-125b-4d00-b431-1aa3795ce1da tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:46.940465 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e537d179-125b-4d00-b431-1aa3795ce1da tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:46.940728 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e537d179-125b-4d00-b431-1aa3795ce1da tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:46.941152 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e537d179-125b-4d00-b431-1aa3795ce1da tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:47.160158 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-e537d179-125b-4d00-b431-1aa3795ce1da tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:47.167616 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e537d179-125b-4d00-b431-1aa3795ce1da tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.239775 Feb 21 01:33:47.168183 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 157/304] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:46 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:47.385981 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-29e3a7bd-010c-4339-b1bd-0ffbff1057eb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:33:47.386406 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-29e3a7bd-010c-4339-b1bd-0ffbff1057eb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:33:47.386905 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-29e3a7bd-010c-4339-b1bd-0ffbff1057eb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:33:47.387311 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-29e3a7bd-010c-4339-b1bd-0ffbff1057eb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:33:47.387718 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-29e3a7bd-010c-4339-b1bd-0ffbff1057eb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:33:47.396235 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e3a7bd-010c-4339-b1bd-0ffbff1057eb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:47.396717 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e3a7bd-010c-4339-b1bd-0ffbff1057eb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:47.397526 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e3a7bd-010c-4339-b1bd-0ffbff1057eb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:47.397963 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29e3a7bd-010c-4339-b1bd-0ffbff1057eb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:47.414414 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-29e3a7bd-010c-4339-b1bd-0ffbff1057eb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Getting quotas for project 11d99a6bb8ad42a980e51a57fcec7315. Resources: {'ram', 'cores', 'instances'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:33:47.418437 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-29e3a7bd-010c-4339-b1bd-0ffbff1057eb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Getting quotas for user 35d4828335a543758d1413c0276657a6 and project 11d99a6bb8ad42a980e51a57fcec7315. Resources: {'ram', 'cores', 'instances'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:33:47.429741 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-29e3a7bd-010c-4339-b1bd-0ffbff1057eb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:33:47.432039 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-29e3a7bd-010c-4339-b1bd-0ffbff1057eb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35936a71-5ec3-4154-b01a-f2dafd8c0364',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:33:47.535620 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-29e3a7bd-010c-4339-b1bd-0ffbff1057eb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.712894 Feb 21 01:33:47.537993 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 148/305] 10.222.0.90 () {60 vars in 1146 bytes} [Mon Feb 21 01:33:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:33:47.547309 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-497d19ed-b59f-4dd2-be1a-bb76983fa346 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:47.547922 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-497d19ed-b59f-4dd2-be1a-bb76983fa346 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:47.603240 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-497d19ed-b59f-4dd2-be1a-bb76983fa346 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:47.610207 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-497d19ed-b59f-4dd2-be1a-bb76983fa346 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1217 microversion: 2.1 time: 0.066477 Feb 21 01:33:47.610795 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 158/306] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:47 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:48.188718 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-34289d52-eff5-4a5c-85d6-0b6f16af8a2d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:48.189888 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-34289d52-eff5-4a5c-85d6-0b6f16af8a2d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:48.196304 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34289d52-eff5-4a5c-85d6-0b6f16af8a2d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:48.196778 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34289d52-eff5-4a5c-85d6-0b6f16af8a2d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:48.197553 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34289d52-eff5-4a5c-85d6-0b6f16af8a2d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:48.197986 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34289d52-eff5-4a5c-85d6-0b6f16af8a2d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:48.334559 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-34289d52-eff5-4a5c-85d6-0b6f16af8a2d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:48.342930 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-34289d52-eff5-4a5c-85d6-0b6f16af8a2d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1521 microversion: 2.1 time: 0.158259 Feb 21 01:33:48.343721 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 149/307] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:48 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:48.627991 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5b2ab409-f034-46b8-aef8-48af53967c3c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:48.629154 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5b2ab409-f034-46b8-aef8-48af53967c3c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:48.636410 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b2ab409-f034-46b8-aef8-48af53967c3c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:48.637094 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b2ab409-f034-46b8-aef8-48af53967c3c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:48.637886 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b2ab409-f034-46b8-aef8-48af53967c3c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:48.638323 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b2ab409-f034-46b8-aef8-48af53967c3c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:48.714522 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-5b2ab409-f034-46b8-aef8-48af53967c3c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:48.724588 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5b2ab409-f034-46b8-aef8-48af53967c3c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1213 microversion: 2.1 time: 0.100557 Feb 21 01:33:48.725289 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 159/308] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:48 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:49.360152 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4fe65b4d-e440-485a-a3b5-90379dc742a8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:49.361656 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4fe65b4d-e440-485a-a3b5-90379dc742a8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:49.370886 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fe65b4d-e440-485a-a3b5-90379dc742a8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:49.371337 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fe65b4d-e440-485a-a3b5-90379dc742a8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:49.372132 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fe65b4d-e440-485a-a3b5-90379dc742a8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:49.372635 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fe65b4d-e440-485a-a3b5-90379dc742a8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:49.528077 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-4fe65b4d-e440-485a-a3b5-90379dc742a8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:49.535402 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4fe65b4d-e440-485a-a3b5-90379dc742a8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1501 microversion: 2.1 time: 0.179032 Feb 21 01:33:49.535970 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 150/309] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:49 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1501 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:49.554201 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5d7c2e31-60a8-4b4e-82b2-f5f14706bac2 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:49.554808 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5d7c2e31-60a8-4b4e-82b2-f5f14706bac2 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:49.560737 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d7c2e31-60a8-4b4e-82b2-f5f14706bac2 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:49.561190 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d7c2e31-60a8-4b4e-82b2-f5f14706bac2 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:49.563322 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d7c2e31-60a8-4b4e-82b2-f5f14706bac2 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:49.563771 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5d7c2e31-60a8-4b4e-82b2-f5f14706bac2 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:49.742812 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-09258fbb-1344-49c0-aaa0-80500b54c80a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:49.747771 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-09258fbb-1344-49c0-aaa0-80500b54c80a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:49.751276 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09258fbb-1344-49c0-aaa0-80500b54c80a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:49.757620 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09258fbb-1344-49c0-aaa0-80500b54c80a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:49.759193 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09258fbb-1344-49c0-aaa0-80500b54c80a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:49.759650 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09258fbb-1344-49c0-aaa0-80500b54c80a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:49.861776 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-09258fbb-1344-49c0-aaa0-80500b54c80a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:49.869065 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-09258fbb-1344-49c0-aaa0-80500b54c80a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1277 microversion: 2.1 time: 0.130028 Feb 21 01:33:49.869731 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 151/310] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:49 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1277 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:33:49.889108 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-5d7c2e31-60a8-4b4e-82b2-f5f14706bac2 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:49.896390 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5d7c2e31-60a8-4b4e-82b2-f5f14706bac2 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1516 microversion: 2.1 time: 0.345826 Feb 21 01:33:49.897056 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 160/311] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:49 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1516 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:50.887410 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6b8b436d-ab27-4608-ba27-023128cb12fc tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:50.888031 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6b8b436d-ab27-4608-ba27-023128cb12fc tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:50.895107 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b8b436d-ab27-4608-ba27-023128cb12fc tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:50.895882 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b8b436d-ab27-4608-ba27-023128cb12fc tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:50.896895 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b8b436d-ab27-4608-ba27-023128cb12fc tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:50.897333 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6b8b436d-ab27-4608-ba27-023128cb12fc tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:51.186862 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-6b8b436d-ab27-4608-ba27-023128cb12fc tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:51.194562 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6b8b436d-ab27-4608-ba27-023128cb12fc tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1317 microversion: 2.1 time: 0.311052 Feb 21 01:33:51.195358 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 152/312] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:50 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:51.605888 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-7cd1758e-1b29-49cf-aa1b-35f1731683ae req-7c30530f-6f01-4fd4-b561-976b8f42c580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1", "tag": "28fa7cb5-9fec-4840-adcc-939e35d2843b"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:33:51.611986 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:33:51.611986 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:33:51.633280 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7cd1758e-1b29-49cf-aa1b-35f1731683ae req-7c30530f-6f01-4fd4-b561-976b8f42c580 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:51.634482 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7cd1758e-1b29-49cf-aa1b-35f1731683ae req-7c30530f-6f01-4fd4-b561-976b8f42c580 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:51.657314 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-7cd1758e-1b29-49cf-aa1b-35f1731683ae req-7c30530f-6f01-4fd4-b561-976b8f42c580 service nova] Creating event network-changed:28fa7cb5-9fec-4840-adcc-939e35d2843b for instance a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 on hv-cinder-81322 Feb 21 01:33:51.657314 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-7cd1758e-1b29-49cf-aa1b-35f1731683ae req-7c30530f-6f01-4fd4-b561-976b8f42c580 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056321 Feb 21 01:33:51.658658 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 161/313] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:33:52.216190 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-991f5165-4d61-4071-86ec-326659f57810 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:52.216190 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-991f5165-4d61-4071-86ec-326659f57810 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:52.218977 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-991f5165-4d61-4071-86ec-326659f57810 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:52.219430 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-991f5165-4d61-4071-86ec-326659f57810 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:52.220211 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-991f5165-4d61-4071-86ec-326659f57810 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:52.220681 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-991f5165-4d61-4071-86ec-326659f57810 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:52.437239 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-991f5165-4d61-4071-86ec-326659f57810 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:52.450105 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-991f5165-4d61-4071-86ec-326659f57810 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1317 microversion: 2.1 time: 0.241484 Feb 21 01:33:52.451983 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 153/314] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:52 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:52.681333 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e03d5d9e-ce7c-4af3-a8a1-479d0a913e35 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:33:52.684657 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e03d5d9e-ce7c-4af3-a8a1-479d0a913e35 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:52.688786 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e03d5d9e-ce7c-4af3-a8a1-479d0a913e35 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:52.689310 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e03d5d9e-ce7c-4af3-a8a1-479d0a913e35 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:52.690091 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e03d5d9e-ce7c-4af3-a8a1-479d0a913e35 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:52.690518 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e03d5d9e-ce7c-4af3-a8a1-479d0a913e35 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:52.714650 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-e03d5d9e-ce7c-4af3-a8a1-479d0a913e35 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lazy-loading 'flavor' on Instance uuid c5323990-b38c-44dd-812e-e5b7b3fd1ea9 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:33:52.989647 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e03d5d9e-ce7c-4af3-a8a1-479d0a913e35 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "POST /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9/action" status: 200 len: 32 microversion: 2.1 time: 0.312875 Feb 21 01:33:52.990262 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 162/315] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Feb 21 01:33:52 2022] POST /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9/action => generated 32 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 01:33:53.000316 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6f2b0523-0872-4406-a9ba-849a1577de7b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:53.001048 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6f2b0523-0872-4406-a9ba-849a1577de7b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:53.007239 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f2b0523-0872-4406-a9ba-849a1577de7b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:53.008027 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f2b0523-0872-4406-a9ba-849a1577de7b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:53.008951 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f2b0523-0872-4406-a9ba-849a1577de7b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:53.014667 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f2b0523-0872-4406-a9ba-849a1577de7b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:53.185954 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-6f2b0523-0872-4406-a9ba-849a1577de7b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:53.193282 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6f2b0523-0872-4406-a9ba-849a1577de7b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.197733 Feb 21 01:33:53.193856 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 154/316] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:52 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:53.467667 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-283e40f5-78a2-485b-ac45-5a725f6b8689 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:53.468364 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-283e40f5-78a2-485b-ac45-5a725f6b8689 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:53.474926 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-283e40f5-78a2-485b-ac45-5a725f6b8689 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:53.475369 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-283e40f5-78a2-485b-ac45-5a725f6b8689 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:53.476144 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-283e40f5-78a2-485b-ac45-5a725f6b8689 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:53.476634 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-283e40f5-78a2-485b-ac45-5a725f6b8689 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:53.739245 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-283e40f5-78a2-485b-ac45-5a725f6b8689 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:53.746960 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-283e40f5-78a2-485b-ac45-5a725f6b8689 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1317 microversion: 2.1 time: 0.283235 Feb 21 01:33:53.747731 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 163/317] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:53 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:54.210730 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c6f7afdc-0191-4fde-8be4-cfdcb87a1281 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:54.211578 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c6f7afdc-0191-4fde-8be4-cfdcb87a1281 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:54.217781 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6f7afdc-0191-4fde-8be4-cfdcb87a1281 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:54.218176 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6f7afdc-0191-4fde-8be4-cfdcb87a1281 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:54.218971 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6f7afdc-0191-4fde-8be4-cfdcb87a1281 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:54.219408 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6f7afdc-0191-4fde-8be4-cfdcb87a1281 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:54.364646 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c6f7afdc-0191-4fde-8be4-cfdcb87a1281 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:54.374114 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c6f7afdc-0191-4fde-8be4-cfdcb87a1281 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.167010 Feb 21 01:33:54.374754 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 155/318] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:54 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:54.763978 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2703cce1-2d33-4b8e-a0f9-407a92631b4e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:54.770591 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2703cce1-2d33-4b8e-a0f9-407a92631b4e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:54.770840 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2703cce1-2d33-4b8e-a0f9-407a92631b4e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:54.771287 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2703cce1-2d33-4b8e-a0f9-407a92631b4e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:54.772053 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2703cce1-2d33-4b8e-a0f9-407a92631b4e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:54.772514 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2703cce1-2d33-4b8e-a0f9-407a92631b4e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:54.910539 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2703cce1-2d33-4b8e-a0f9-407a92631b4e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:54.917731 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2703cce1-2d33-4b8e-a0f9-407a92631b4e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1317 microversion: 2.1 time: 0.157330 Feb 21 01:33:54.918295 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 164/319] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:54 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:55.391413 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b5cdf96e-d8ee-46df-b2c3-83bbd53cf3ed tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:55.391995 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b5cdf96e-d8ee-46df-b2c3-83bbd53cf3ed tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:55.398532 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5cdf96e-d8ee-46df-b2c3-83bbd53cf3ed tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:55.399090 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5cdf96e-d8ee-46df-b2c3-83bbd53cf3ed tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:55.399875 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5cdf96e-d8ee-46df-b2c3-83bbd53cf3ed tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:55.400347 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b5cdf96e-d8ee-46df-b2c3-83bbd53cf3ed tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:55.535848 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-b5cdf96e-d8ee-46df-b2c3-83bbd53cf3ed tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:55.543250 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b5cdf96e-d8ee-46df-b2c3-83bbd53cf3ed tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.155482 Feb 21 01:33:55.544045 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 156/320] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:55 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:55.933985 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-97e6d176-7f97-4d69-b98f-8fb421e6a5b2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:55.934574 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-97e6d176-7f97-4d69-b98f-8fb421e6a5b2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:55.940781 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97e6d176-7f97-4d69-b98f-8fb421e6a5b2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:55.941220 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97e6d176-7f97-4d69-b98f-8fb421e6a5b2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:55.941979 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97e6d176-7f97-4d69-b98f-8fb421e6a5b2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:55.942401 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-97e6d176-7f97-4d69-b98f-8fb421e6a5b2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:56.077528 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-97e6d176-7f97-4d69-b98f-8fb421e6a5b2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:56.085217 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-97e6d176-7f97-4d69-b98f-8fb421e6a5b2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1317 microversion: 2.1 time: 0.154796 Feb 21 01:33:56.086303 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 165/321] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:55 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:56.560003 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-811470e0-9aff-487f-abc0-d96fbfcf18eb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:56.560645 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-811470e0-9aff-487f-abc0-d96fbfcf18eb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:56.567408 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-811470e0-9aff-487f-abc0-d96fbfcf18eb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:56.567870 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-811470e0-9aff-487f-abc0-d96fbfcf18eb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:56.578163 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-811470e0-9aff-487f-abc0-d96fbfcf18eb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:56.578163 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-811470e0-9aff-487f-abc0-d96fbfcf18eb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:56.717067 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-811470e0-9aff-487f-abc0-d96fbfcf18eb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:56.724927 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-811470e0-9aff-487f-abc0-d96fbfcf18eb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.168808 Feb 21 01:33:56.725485 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 157/322] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:56 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:57.102090 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-56284613-f56c-4afc-a716-4b5e9d1486b0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:57.102694 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-56284613-f56c-4afc-a716-4b5e9d1486b0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:57.108247 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56284613-f56c-4afc-a716-4b5e9d1486b0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:57.108718 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56284613-f56c-4afc-a716-4b5e9d1486b0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:57.109468 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56284613-f56c-4afc-a716-4b5e9d1486b0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:57.109890 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-56284613-f56c-4afc-a716-4b5e9d1486b0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:57.248360 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-56284613-f56c-4afc-a716-4b5e9d1486b0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:57.256254 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-56284613-f56c-4afc-a716-4b5e9d1486b0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1317 microversion: 2.1 time: 0.157587 Feb 21 01:33:57.257035 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 166/323] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:57 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:57.741486 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e72a43bd-c409-4d3e-8bbb-9ea4a6556c9c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:57.742130 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e72a43bd-c409-4d3e-8bbb-9ea4a6556c9c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:57.748568 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e72a43bd-c409-4d3e-8bbb-9ea4a6556c9c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:57.749291 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e72a43bd-c409-4d3e-8bbb-9ea4a6556c9c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:57.749841 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e72a43bd-c409-4d3e-8bbb-9ea4a6556c9c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:57.750268 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e72a43bd-c409-4d3e-8bbb-9ea4a6556c9c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:57.899579 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-e72a43bd-c409-4d3e-8bbb-9ea4a6556c9c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:57.906714 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e72a43bd-c409-4d3e-8bbb-9ea4a6556c9c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.168880 Feb 21 01:33:57.907281 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 158/324] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:57 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:58.273963 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c2481c4d-2de2-4669-ad9a-6286e73cc84b tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:58.274618 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c2481c4d-2de2-4669-ad9a-6286e73cc84b tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:58.280441 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2481c4d-2de2-4669-ad9a-6286e73cc84b tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:58.280889 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2481c4d-2de2-4669-ad9a-6286e73cc84b tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:58.281649 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2481c4d-2de2-4669-ad9a-6286e73cc84b tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:58.282073 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c2481c4d-2de2-4669-ad9a-6286e73cc84b tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:58.420850 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-c2481c4d-2de2-4669-ad9a-6286e73cc84b tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:58.428214 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c2481c4d-2de2-4669-ad9a-6286e73cc84b tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1317 microversion: 2.1 time: 0.157946 Feb 21 01:33:58.428795 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 167/325] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:58 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:58.924156 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d2b26355-62d6-402e-aee2-3896f38e4458 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:58.930702 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d2b26355-62d6-402e-aee2-3896f38e4458 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:58.931071 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2b26355-62d6-402e-aee2-3896f38e4458 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:58.931520 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2b26355-62d6-402e-aee2-3896f38e4458 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:58.932296 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2b26355-62d6-402e-aee2-3896f38e4458 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:58.932787 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2b26355-62d6-402e-aee2-3896f38e4458 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:59.087774 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-d2b26355-62d6-402e-aee2-3896f38e4458 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:59.095210 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d2b26355-62d6-402e-aee2-3896f38e4458 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.174913 Feb 21 01:33:59.095807 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 159/326] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:58 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:33:59.444871 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ef69d524-2be8-46ba-8c6f-e3a80afb7dea tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:33:59.445476 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ef69d524-2be8-46ba-8c6f-e3a80afb7dea tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:33:59.451458 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef69d524-2be8-46ba-8c6f-e3a80afb7dea tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:59.451901 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef69d524-2be8-46ba-8c6f-e3a80afb7dea tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:59.453040 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef69d524-2be8-46ba-8c6f-e3a80afb7dea tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:33:59.453160 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ef69d524-2be8-46ba-8c6f-e3a80afb7dea tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:33:59.593676 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-ef69d524-2be8-46ba-8c6f-e3a80afb7dea tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:33:59.602207 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ef69d524-2be8-46ba-8c6f-e3a80afb7dea tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1317 microversion: 2.1 time: 0.160881 Feb 21 01:33:59.602778 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 168/327] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:33:59 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:00.111096 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-61320d7f-5c39-484b-a21e-4763ad6ff910 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:00.112286 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-61320d7f-5c39-484b-a21e-4763ad6ff910 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:00.118389 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61320d7f-5c39-484b-a21e-4763ad6ff910 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:00.118843 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61320d7f-5c39-484b-a21e-4763ad6ff910 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:00.119631 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61320d7f-5c39-484b-a21e-4763ad6ff910 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:00.120997 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61320d7f-5c39-484b-a21e-4763ad6ff910 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:00.261354 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-61320d7f-5c39-484b-a21e-4763ad6ff910 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:00.269485 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-61320d7f-5c39-484b-a21e-4763ad6ff910 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.162022 Feb 21 01:34:00.270445 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 160/328] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:00 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:00.624514 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1478b958-f98f-4a3a-a657-c8d771fcb6e6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:00.625133 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1478b958-f98f-4a3a-a657-c8d771fcb6e6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:00.631605 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1478b958-f98f-4a3a-a657-c8d771fcb6e6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:00.632055 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1478b958-f98f-4a3a-a657-c8d771fcb6e6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:00.633184 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1478b958-f98f-4a3a-a657-c8d771fcb6e6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:00.633621 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1478b958-f98f-4a3a-a657-c8d771fcb6e6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:00.766664 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1478b958-f98f-4a3a-a657-c8d771fcb6e6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:00.773960 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1478b958-f98f-4a3a-a657-c8d771fcb6e6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1317 microversion: 2.1 time: 0.153352 Feb 21 01:34:00.774508 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 169/329] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:00 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:01.286572 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4ed4acea-db97-4a9a-bd5f-55b14d4fc77d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:01.287214 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4ed4acea-db97-4a9a-bd5f-55b14d4fc77d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:01.293584 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ed4acea-db97-4a9a-bd5f-55b14d4fc77d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:01.294035 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ed4acea-db97-4a9a-bd5f-55b14d4fc77d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:01.294807 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ed4acea-db97-4a9a-bd5f-55b14d4fc77d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:01.295238 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ed4acea-db97-4a9a-bd5f-55b14d4fc77d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:01.445974 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-c5d0b159-3917-4bd6-944c-9b6fd92b6aa3 req-7d703e5f-f1da-4a3f-ae6b-0c1edd068fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1", "name": "network-vif-plugged", "status": "completed", "tag": "28fa7cb5-9fec-4840-adcc-939e35d2843b"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:34:01.448124 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:34:01.448124 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:34:01.455754 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c5d0b159-3917-4bd6-944c-9b6fd92b6aa3 req-7d703e5f-f1da-4a3f-ae6b-0c1edd068fa9 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:01.456188 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c5d0b159-3917-4bd6-944c-9b6fd92b6aa3 req-7d703e5f-f1da-4a3f-ae6b-0c1edd068fa9 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:01.466952 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-c5d0b159-3917-4bd6-944c-9b6fd92b6aa3 req-7d703e5f-f1da-4a3f-ae6b-0c1edd068fa9 service nova] Creating event network-vif-plugged:28fa7cb5-9fec-4840-adcc-939e35d2843b for instance a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 on hv-cinder-81322 Feb 21 01:34:01.472581 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-c5d0b159-3917-4bd6-944c-9b6fd92b6aa3 req-7d703e5f-f1da-4a3f-ae6b-0c1edd068fa9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031209 Feb 21 01:34:01.473171 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 170/330] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:34:01.476114 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-4ed4acea-db97-4a9a-bd5f-55b14d4fc77d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:01.484872 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4ed4acea-db97-4a9a-bd5f-55b14d4fc77d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.202764 Feb 21 01:34:01.485564 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 161/331] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:01 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:01.791504 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8123eaa0-e5df-4eb4-80ff-897c7e3a6bbd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:01.792214 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8123eaa0-e5df-4eb4-80ff-897c7e3a6bbd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:01.798379 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8123eaa0-e5df-4eb4-80ff-897c7e3a6bbd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:01.798900 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8123eaa0-e5df-4eb4-80ff-897c7e3a6bbd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:01.799747 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8123eaa0-e5df-4eb4-80ff-897c7e3a6bbd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:01.800253 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8123eaa0-e5df-4eb4-80ff-897c7e3a6bbd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:01.984065 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-8123eaa0-e5df-4eb4-80ff-897c7e3a6bbd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:01.991772 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8123eaa0-e5df-4eb4-80ff-897c7e3a6bbd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1317 microversion: 2.1 time: 0.204353 Feb 21 01:34:01.992336 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 171/332] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:01 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:02.501916 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6c766bf4-8161-4fce-9cf6-b38ba5add33a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:02.502561 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6c766bf4-8161-4fce-9cf6-b38ba5add33a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:02.509360 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c766bf4-8161-4fce-9cf6-b38ba5add33a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:02.509805 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c766bf4-8161-4fce-9cf6-b38ba5add33a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:02.510560 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c766bf4-8161-4fce-9cf6-b38ba5add33a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:02.510983 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c766bf4-8161-4fce-9cf6-b38ba5add33a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:02.645495 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-6c766bf4-8161-4fce-9cf6-b38ba5add33a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:02.656415 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6c766bf4-8161-4fce-9cf6-b38ba5add33a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.158460 Feb 21 01:34:02.657006 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 162/333] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:02 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:03.009628 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d728aa32-e20c-46f7-a8a6-5005027328ad tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:03.010473 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d728aa32-e20c-46f7-a8a6-5005027328ad tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:03.016715 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d728aa32-e20c-46f7-a8a6-5005027328ad tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:03.017938 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d728aa32-e20c-46f7-a8a6-5005027328ad tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:03.018783 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d728aa32-e20c-46f7-a8a6-5005027328ad tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:03.019210 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d728aa32-e20c-46f7-a8a6-5005027328ad tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:03.153975 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-d728aa32-e20c-46f7-a8a6-5005027328ad tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:03.161447 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d728aa32-e20c-46f7-a8a6-5005027328ad tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1317 microversion: 2.1 time: 0.156112 Feb 21 01:34:03.162010 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 172/334] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:03 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:03.674474 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4fce7576-1d10-42a7-89fc-a478fe050559 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:03.675116 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4fce7576-1d10-42a7-89fc-a478fe050559 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:03.681356 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fce7576-1d10-42a7-89fc-a478fe050559 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:03.681794 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fce7576-1d10-42a7-89fc-a478fe050559 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:03.682566 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fce7576-1d10-42a7-89fc-a478fe050559 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:03.682993 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fce7576-1d10-42a7-89fc-a478fe050559 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:03.908479 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-4fce7576-1d10-42a7-89fc-a478fe050559 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:03.916329 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4fce7576-1d10-42a7-89fc-a478fe050559 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.246155 Feb 21 01:34:03.916952 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 163/335] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:03 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:04.178307 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5e82e07f-f8e5-47e5-a3fa-b3c0c95777c6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:04.179491 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5e82e07f-f8e5-47e5-a3fa-b3c0c95777c6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:04.185301 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e82e07f-f8e5-47e5-a3fa-b3c0c95777c6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:04.185751 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e82e07f-f8e5-47e5-a3fa-b3c0c95777c6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:04.186549 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e82e07f-f8e5-47e5-a3fa-b3c0c95777c6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:04.186984 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e82e07f-f8e5-47e5-a3fa-b3c0c95777c6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:04.337439 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-5e82e07f-f8e5-47e5-a3fa-b3c0c95777c6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:04.359630 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5e82e07f-f8e5-47e5-a3fa-b3c0c95777c6 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1506 microversion: 2.1 time: 0.185851 Feb 21 01:34:04.360689 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 173/336] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:04 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:04.935594 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dc8779bc-21a2-4d54-9803-1deb131e7e3b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:04.936336 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dc8779bc-21a2-4d54-9803-1deb131e7e3b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:04.943604 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc8779bc-21a2-4d54-9803-1deb131e7e3b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:04.944143 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc8779bc-21a2-4d54-9803-1deb131e7e3b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:04.945068 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc8779bc-21a2-4d54-9803-1deb131e7e3b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:04.945575 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dc8779bc-21a2-4d54-9803-1deb131e7e3b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:05.086816 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-dc8779bc-21a2-4d54-9803-1deb131e7e3b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:05.094369 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dc8779bc-21a2-4d54-9803-1deb131e7e3b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.163843 Feb 21 01:34:05.094945 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 164/337] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:04 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:06.110831 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4b41d20f-642b-42eb-a078-127afae05bc4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:06.111436 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4b41d20f-642b-42eb-a078-127afae05bc4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:06.117385 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b41d20f-642b-42eb-a078-127afae05bc4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:06.117829 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b41d20f-642b-42eb-a078-127afae05bc4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:06.118594 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b41d20f-642b-42eb-a078-127afae05bc4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:06.119119 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b41d20f-642b-42eb-a078-127afae05bc4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:06.248362 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-4b41d20f-642b-42eb-a078-127afae05bc4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:06.256138 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4b41d20f-642b-42eb-a078-127afae05bc4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.148957 Feb 21 01:34:06.256666 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 174/338] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:06 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:07.097833 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f0e47c80-2131-44ba-9b51-9acff4958759 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3df4775-d9fa-47f0-86ed-62ab85a8b959"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:34:07.099478 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f0e47c80-2131-44ba-9b51-9acff4958759 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:07.106245 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0e47c80-2131-44ba-9b51-9acff4958759 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:07.106697 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0e47c80-2131-44ba-9b51-9acff4958759 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:07.107505 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0e47c80-2131-44ba-9b51-9acff4958759 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:07.107941 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0e47c80-2131-44ba-9b51-9acff4958759 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:07.273154 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9c441b0a-9c9b-4b10-a47c-625423820ef7 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:07.273857 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9c441b0a-9c9b-4b10-a47c-625423820ef7 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:07.279613 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c441b0a-9c9b-4b10-a47c-625423820ef7 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:07.280053 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c441b0a-9c9b-4b10-a47c-625423820ef7 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:07.280850 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c441b0a-9c9b-4b10-a47c-625423820ef7 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:07.281280 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c441b0a-9c9b-4b10-a47c-625423820ef7 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:07.413203 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-9c441b0a-9c9b-4b10-a47c-625423820ef7 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:07.420450 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9c441b0a-9c9b-4b10-a47c-625423820ef7 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.151407 Feb 21 01:34:07.421040 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 175/339] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:07 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:34:08.437373 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-605dd27b-62fe-408f-b213-af976f297a0e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:08.437979 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-605dd27b-62fe-408f-b213-af976f297a0e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:08.443618 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-605dd27b-62fe-408f-b213-af976f297a0e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:08.444065 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-605dd27b-62fe-408f-b213-af976f297a0e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:08.444866 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-605dd27b-62fe-408f-b213-af976f297a0e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:08.445302 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-605dd27b-62fe-408f-b213-af976f297a0e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:08.577816 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-605dd27b-62fe-408f-b213-af976f297a0e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:08.584930 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-605dd27b-62fe-408f-b213-af976f297a0e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.151364 Feb 21 01:34:08.586004 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 176/340] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:08 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:34:09.602001 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7457c31f-781d-414e-80b0-e88ae3841a8e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:09.602650 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7457c31f-781d-414e-80b0-e88ae3841a8e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:09.608372 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7457c31f-781d-414e-80b0-e88ae3841a8e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:09.608855 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7457c31f-781d-414e-80b0-e88ae3841a8e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:09.609623 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7457c31f-781d-414e-80b0-e88ae3841a8e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:09.610057 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7457c31f-781d-414e-80b0-e88ae3841a8e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:09.744384 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-7457c31f-781d-414e-80b0-e88ae3841a8e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:09.751560 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7457c31f-781d-414e-80b0-e88ae3841a8e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.153149 Feb 21 01:34:09.752122 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 177/341] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:09 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:34:10.768571 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4bfd5af3-0e05-4fe2-bcf0-e8cde33ad742 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:10.769267 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4bfd5af3-0e05-4fe2-bcf0-e8cde33ad742 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:10.775752 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bfd5af3-0e05-4fe2-bcf0-e8cde33ad742 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:10.776206 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bfd5af3-0e05-4fe2-bcf0-e8cde33ad742 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:10.777028 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bfd5af3-0e05-4fe2-bcf0-e8cde33ad742 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:10.777465 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4bfd5af3-0e05-4fe2-bcf0-e8cde33ad742 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:10.916644 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-4bfd5af3-0e05-4fe2-bcf0-e8cde33ad742 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:10.924051 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4bfd5af3-0e05-4fe2-bcf0-e8cde33ad742 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.159329 Feb 21 01:34:10.924639 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 178/342] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:10 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:34:11.940643 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5071d267-218b-4d4c-9471-c483bdfe23e4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:11.941258 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5071d267-218b-4d4c-9471-c483bdfe23e4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:11.947515 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5071d267-218b-4d4c-9471-c483bdfe23e4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:11.947959 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5071d267-218b-4d4c-9471-c483bdfe23e4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:11.948758 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5071d267-218b-4d4c-9471-c483bdfe23e4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:11.949186 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5071d267-218b-4d4c-9471-c483bdfe23e4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:12.077543 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-5071d267-218b-4d4c-9471-c483bdfe23e4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:12.084726 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5071d267-218b-4d4c-9471-c483bdfe23e4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.147560 Feb 21 01:34:12.085950 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 179/343] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:11 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:34:13.102277 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0dc1f468-4b2a-4d93-a08e-76207471007d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:13.102943 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0dc1f468-4b2a-4d93-a08e-76207471007d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:13.108597 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0dc1f468-4b2a-4d93-a08e-76207471007d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:13.109050 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0dc1f468-4b2a-4d93-a08e-76207471007d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:13.109826 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0dc1f468-4b2a-4d93-a08e-76207471007d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:13.110261 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0dc1f468-4b2a-4d93-a08e-76207471007d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:13.278780 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-0dc1f468-4b2a-4d93-a08e-76207471007d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:13.286026 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0dc1f468-4b2a-4d93-a08e-76207471007d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.187389 Feb 21 01:34:13.286584 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 180/344] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:13 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:34:13.641252 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f0e47c80-2131-44ba-9b51-9acff4958759 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "POST /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.548051 Feb 21 01:34:13.642599 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 165/345] 10.222.0.90 () {60 vars in 1322 bytes} [Mon Feb 21 01:34:07 2022] POST /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments => generated 194 bytes in 6551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:34:14.303140 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-da330dcf-5cc8-4026-bffc-dc1d9a0d29b5 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:14.303668 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-da330dcf-5cc8-4026-bffc-dc1d9a0d29b5 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:14.310225 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da330dcf-5cc8-4026-bffc-dc1d9a0d29b5 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:14.312973 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da330dcf-5cc8-4026-bffc-dc1d9a0d29b5 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:14.312973 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da330dcf-5cc8-4026-bffc-dc1d9a0d29b5 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:14.312973 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da330dcf-5cc8-4026-bffc-dc1d9a0d29b5 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:14.671085 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-da330dcf-5cc8-4026-bffc-dc1d9a0d29b5 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:14.679177 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-da330dcf-5cc8-4026-bffc-dc1d9a0d29b5 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.379909 Feb 21 01:34:14.679994 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 181/346] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:14 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:15.697730 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a4ce9309-8950-47bc-97e1-64df55b2c711 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:15.698423 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a4ce9309-8950-47bc-97e1-64df55b2c711 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:15.705107 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4ce9309-8950-47bc-97e1-64df55b2c711 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:15.705552 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4ce9309-8950-47bc-97e1-64df55b2c711 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:15.706316 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4ce9309-8950-47bc-97e1-64df55b2c711 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:15.706785 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a4ce9309-8950-47bc-97e1-64df55b2c711 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:15.843768 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-a4ce9309-8950-47bc-97e1-64df55b2c711 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:15.853476 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a4ce9309-8950-47bc-97e1-64df55b2c711 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.158787 Feb 21 01:34:15.853476 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 166/347] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:15 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:16.868893 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1e47c51b-5f31-48c2-8e3b-b8a4bd647ebf tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:16.869442 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1e47c51b-5f31-48c2-8e3b-b8a4bd647ebf tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:16.875164 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e47c51b-5f31-48c2-8e3b-b8a4bd647ebf tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:16.881534 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e47c51b-5f31-48c2-8e3b-b8a4bd647ebf tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:16.881534 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e47c51b-5f31-48c2-8e3b-b8a4bd647ebf tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:16.881534 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e47c51b-5f31-48c2-8e3b-b8a4bd647ebf tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:17.017728 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1e47c51b-5f31-48c2-8e3b-b8a4bd647ebf tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:17.025658 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1e47c51b-5f31-48c2-8e3b-b8a4bd647ebf tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1502 microversion: 2.1 time: 0.160955 Feb 21 01:34:17.026311 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 182/348] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:16 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:17.041673 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f4f9a384-7afc-42f5-b1c6-d6b0de62f96f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5446d43-4199-4518-aee8-f230e656faab"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:34:17.042775 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f4f9a384-7afc-42f5-b1c6-d6b0de62f96f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:17.048967 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4f9a384-7afc-42f5-b1c6-d6b0de62f96f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:17.049396 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4f9a384-7afc-42f5-b1c6-d6b0de62f96f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:17.050161 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4f9a384-7afc-42f5-b1c6-d6b0de62f96f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:17.050591 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f4f9a384-7afc-42f5-b1c6-d6b0de62f96f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:17.074372 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-f4f9a384-7afc-42f5-b1c6-d6b0de62f96f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] HTTP exception thrown: Cannot 'attach_volume' instance c5323990-b38c-44dd-812e-e5b7b3fd1ea9 while it is in vm_state rescued Feb 21 01:34:17.074952 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f4f9a384-7afc-42f5-b1c6-d6b0de62f96f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Returning 409 to user: Cannot 'attach_volume' instance c5323990-b38c-44dd-812e-e5b7b3fd1ea9 while it is in vm_state rescued {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:34:17.075762 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f4f9a384-7afc-42f5-b1c6-d6b0de62f96f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "POST /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.037908 Feb 21 01:34:17.076290 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 167/349] 10.222.0.90 () {60 vars in 1322 bytes} [Mon Feb 21 01:34:17 2022] POST /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9/os-volume_attachments => generated 152 bytes in 39 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 21 01:34:17.084778 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-36f81a70-086c-4e1a-aac8-bdd824fe1c5f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:34:17.085423 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-36f81a70-086c-4e1a-aac8-bdd824fe1c5f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:17.091128 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-36f81a70-086c-4e1a-aac8-bdd824fe1c5f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:17.091581 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-36f81a70-086c-4e1a-aac8-bdd824fe1c5f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:17.092354 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-36f81a70-086c-4e1a-aac8-bdd824fe1c5f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:17.092819 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-36f81a70-086c-4e1a-aac8-bdd824fe1c5f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:17.314141 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-36f81a70-086c-4e1a-aac8-bdd824fe1c5f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "POST /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9/action" status: 202 len: 0 microversion: 2.1 time: 0.232737 Feb 21 01:34:17.315186 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 183/350] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Feb 21 01:34:17 2022] POST /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:34:17.323814 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c415a3a2-08e2-407a-9ba1-c7711034c655 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:17.324479 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c415a3a2-08e2-407a-9ba1-c7711034c655 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:17.330232 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c415a3a2-08e2-407a-9ba1-c7711034c655 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:17.330680 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c415a3a2-08e2-407a-9ba1-c7711034c655 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:17.331457 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c415a3a2-08e2-407a-9ba1-c7711034c655 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:17.331890 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c415a3a2-08e2-407a-9ba1-c7711034c655 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:17.501977 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c415a3a2-08e2-407a-9ba1-c7711034c655 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:17.509693 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c415a3a2-08e2-407a-9ba1-c7711034c655 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1510 microversion: 2.1 time: 0.190102 Feb 21 01:34:17.510251 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 168/351] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:17 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1510 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:18.537959 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-61bc3d4b-8b06-4ebb-9e1c-62f1f01987c0 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:18.538657 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-61bc3d4b-8b06-4ebb-9e1c-62f1f01987c0 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:18.544881 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61bc3d4b-8b06-4ebb-9e1c-62f1f01987c0 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:18.545332 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61bc3d4b-8b06-4ebb-9e1c-62f1f01987c0 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:18.546105 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61bc3d4b-8b06-4ebb-9e1c-62f1f01987c0 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:18.546540 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-61bc3d4b-8b06-4ebb-9e1c-62f1f01987c0 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:18.679148 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-61bc3d4b-8b06-4ebb-9e1c-62f1f01987c0 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:18.686998 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-61bc3d4b-8b06-4ebb-9e1c-62f1f01987c0 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1510 microversion: 2.1 time: 0.153258 Feb 21 01:34:18.687630 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 184/352] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:18 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:19.704535 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4d037972-b360-4bc4-940a-6257eb5636f2 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:19.705128 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4d037972-b360-4bc4-940a-6257eb5636f2 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:19.712019 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d037972-b360-4bc4-940a-6257eb5636f2 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:19.712475 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d037972-b360-4bc4-940a-6257eb5636f2 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:19.713246 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d037972-b360-4bc4-940a-6257eb5636f2 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:19.713669 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4d037972-b360-4bc4-940a-6257eb5636f2 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:19.845007 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-4d037972-b360-4bc4-940a-6257eb5636f2 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:19.852224 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4d037972-b360-4bc4-940a-6257eb5636f2 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1510 microversion: 2.1 time: 0.151394 Feb 21 01:34:19.852811 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 169/353] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:19 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:20.873379 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5db209ae-f90c-49c4-aadf-55acbbb6f05d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:20.874008 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5db209ae-f90c-49c4-aadf-55acbbb6f05d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:20.879943 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5db209ae-f90c-49c4-aadf-55acbbb6f05d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:20.880465 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5db209ae-f90c-49c4-aadf-55acbbb6f05d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:20.881239 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5db209ae-f90c-49c4-aadf-55acbbb6f05d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:20.881676 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5db209ae-f90c-49c4-aadf-55acbbb6f05d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:21.015698 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-5db209ae-f90c-49c4-aadf-55acbbb6f05d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:21.023192 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5db209ae-f90c-49c4-aadf-55acbbb6f05d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1510 microversion: 2.1 time: 0.153396 Feb 21 01:34:21.024404 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 185/354] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:20 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:22.041213 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-af7e96f7-a57e-491f-a949-eb7bc48879be tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:22.045925 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-af7e96f7-a57e-491f-a949-eb7bc48879be tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:22.047954 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af7e96f7-a57e-491f-a949-eb7bc48879be tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:22.048401 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af7e96f7-a57e-491f-a949-eb7bc48879be tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:22.049217 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af7e96f7-a57e-491f-a949-eb7bc48879be tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:22.049649 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af7e96f7-a57e-491f-a949-eb7bc48879be tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:22.190058 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-af7e96f7-a57e-491f-a949-eb7bc48879be tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:22.197354 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-af7e96f7-a57e-491f-a949-eb7bc48879be tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1516 microversion: 2.1 time: 0.160371 Feb 21 01:34:22.197906 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 170/355] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:22 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:34:25.872532 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3a71f87d-642e-44e4-9e74-037aa69c8007 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:25.873100 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3a71f87d-642e-44e4-9e74-037aa69c8007 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:25.878948 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a71f87d-642e-44e4-9e74-037aa69c8007 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:25.879390 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a71f87d-642e-44e4-9e74-037aa69c8007 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:25.880145 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a71f87d-642e-44e4-9e74-037aa69c8007 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:25.880597 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a71f87d-642e-44e4-9e74-037aa69c8007 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:26.006635 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-3a71f87d-642e-44e4-9e74-037aa69c8007 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:26.013987 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3a71f87d-642e-44e4-9e74-037aa69c8007 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1516 microversion: 2.1 time: 0.145054 Feb 21 01:34:26.014540 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 186/356] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:25 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1516 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:26.030322 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3689bfd4-c091-4b8b-baf8-de70a87b5597 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eda42a2d-2d9c-4389-89f2-2b9608ce0cd6"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:34:26.031367 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3689bfd4-c091-4b8b-baf8-de70a87b5597 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:26.037509 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3689bfd4-c091-4b8b-baf8-de70a87b5597 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:26.037957 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3689bfd4-c091-4b8b-baf8-de70a87b5597 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:26.038718 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3689bfd4-c091-4b8b-baf8-de70a87b5597 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:26.039768 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3689bfd4-c091-4b8b-baf8-de70a87b5597 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:26.765098 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3689bfd4-c091-4b8b-baf8-de70a87b5597 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "POST /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.738251 Feb 21 01:34:26.765703 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 171/357] 10.222.0.90 () {60 vars in 1322 bytes} [Mon Feb 21 01:34:26 2022] POST /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9/os-volume_attachments => generated 194 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:34:28.462029 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-76f68944-4b54-4a49-ba0b-ed07c88bef2e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3df4775-d9fa-47f0-86ed-62ab85a8b959"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:34:28.463090 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-76f68944-4b54-4a49-ba0b-ed07c88bef2e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:28.468754 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76f68944-4b54-4a49-ba0b-ed07c88bef2e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:28.469201 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76f68944-4b54-4a49-ba0b-ed07c88bef2e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:28.469967 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76f68944-4b54-4a49-ba0b-ed07c88bef2e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:28.470402 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76f68944-4b54-4a49-ba0b-ed07c88bef2e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:28.546133 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-76f68944-4b54-4a49-ba0b-ed07c88bef2e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] HTTP exception thrown: Invalid volume: volume e3df4775-d9fa-47f0-86ed-62ab85a8b959 is already attached to instances: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 Feb 21 01:34:28.546728 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-76f68944-4b54-4a49-ba0b-ed07c88bef2e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Returning 400 to user: Invalid volume: volume e3df4775-d9fa-47f0-86ed-62ab85a8b959 is already attached to instances: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:34:28.547598 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-76f68944-4b54-4a49-ba0b-ed07c88bef2e tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "POST /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.089940 Feb 21 01:34:28.548136 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 187/358] 10.222.0.90 () {60 vars in 1322 bytes} [Mon Feb 21 01:34:28 2022] POST /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments => generated 174 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:34:28.616533 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ad7bd196-4984-440f-b463-e006eef20e7c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:28.617055 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ad7bd196-4984-440f-b463-e006eef20e7c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:28.623971 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad7bd196-4984-440f-b463-e006eef20e7c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:28.624527 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad7bd196-4984-440f-b463-e006eef20e7c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:28.625301 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad7bd196-4984-440f-b463-e006eef20e7c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:28.625725 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad7bd196-4984-440f-b463-e006eef20e7c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:28.744978 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-ad7bd196-4984-440f-b463-e006eef20e7c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lazy-loading 'services' on Instance uuid a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:34:28.989052 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ad7bd196-4984-440f-b463-e006eef20e7c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "DELETE /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments/e3df4775-d9fa-47f0-86ed-62ab85a8b959" status: 202 len: 0 microversion: 2.1 time: 0.376489 Feb 21 01:34:28.989762 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 172/359] 10.222.0.90 () {58 vars in 1415 bytes} [Mon Feb 21 01:34:28 2022] DELETE /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments/e3df4775-d9fa-47f0-86ed-62ab85a8b959 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:34:28.998344 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b08395c1-6464-4614-8783-e3504ada913d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:28.999323 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b08395c1-6464-4614-8783-e3504ada913d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:29.005908 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b08395c1-6464-4614-8783-e3504ada913d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:29.006340 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b08395c1-6464-4614-8783-e3504ada913d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:29.007095 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b08395c1-6464-4614-8783-e3504ada913d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:29.008405 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b08395c1-6464-4614-8783-e3504ada913d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:29.037032 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b08395c1-6464-4614-8783-e3504ada913d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042317 Feb 21 01:34:29.037578 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 188/360] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:34:28 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:34:30.049178 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c9e7537e-2d70-4507-a801-58319d39d595 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:30.050243 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c9e7537e-2d70-4507-a801-58319d39d595 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:30.056175 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9e7537e-2d70-4507-a801-58319d39d595 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:30.056666 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9e7537e-2d70-4507-a801-58319d39d595 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:30.057431 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9e7537e-2d70-4507-a801-58319d39d595 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:30.057862 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c9e7537e-2d70-4507-a801-58319d39d595 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:30.092772 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c9e7537e-2d70-4507-a801-58319d39d595 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048019 Feb 21 01:34:30.093665 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 173/361] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:34:30 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:34:31.104210 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-51cc132a-3d35-40b0-8e14-443477b0b3ce tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:31.105140 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-51cc132a-3d35-40b0-8e14-443477b0b3ce tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:31.110887 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51cc132a-3d35-40b0-8e14-443477b0b3ce tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:31.111328 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51cc132a-3d35-40b0-8e14-443477b0b3ce tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:31.112317 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51cc132a-3d35-40b0-8e14-443477b0b3ce tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:31.112776 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-51cc132a-3d35-40b0-8e14-443477b0b3ce tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:31.142859 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-51cc132a-3d35-40b0-8e14-443477b0b3ce tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042382 Feb 21 01:34:31.143414 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 189/362] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:34:31 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:34:32.154375 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-19820f17-123c-44cd-b5b1-cef8ef4bbd91 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:32.155204 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-19820f17-123c-44cd-b5b1-cef8ef4bbd91 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:32.161400 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19820f17-123c-44cd-b5b1-cef8ef4bbd91 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:32.161839 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19820f17-123c-44cd-b5b1-cef8ef4bbd91 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:32.162590 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19820f17-123c-44cd-b5b1-cef8ef4bbd91 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:32.163008 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19820f17-123c-44cd-b5b1-cef8ef4bbd91 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:32.193928 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-19820f17-123c-44cd-b5b1-cef8ef4bbd91 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043345 Feb 21 01:34:32.194469 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 174/363] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:34:32 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:34:33.208878 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d6668519-d2f7-4cb2-814a-ab3dafd772d1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:33.209803 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d6668519-d2f7-4cb2-814a-ab3dafd772d1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:33.215617 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6668519-d2f7-4cb2-814a-ab3dafd772d1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:33.216060 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6668519-d2f7-4cb2-814a-ab3dafd772d1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:33.216861 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6668519-d2f7-4cb2-814a-ab3dafd772d1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:33.217293 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d6668519-d2f7-4cb2-814a-ab3dafd772d1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:33.246048 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d6668519-d2f7-4cb2-814a-ab3dafd772d1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044016 Feb 21 01:34:33.246591 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 190/364] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:34:33 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:34:34.258157 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cc49b648-471f-4448-9743-9f090165747f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:34.259340 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cc49b648-471f-4448-9743-9f090165747f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:34.265594 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc49b648-471f-4448-9743-9f090165747f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:34.266037 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc49b648-471f-4448-9743-9f090165747f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:34.266811 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc49b648-471f-4448-9743-9f090165747f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:34.267242 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc49b648-471f-4448-9743-9f090165747f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:34.294875 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cc49b648-471f-4448-9743-9f090165747f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041138 Feb 21 01:34:34.295431 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 175/365] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:34:34 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:34:35.306954 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0ab4d10e-243b-4ed5-8263-6b0073cd2eac tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:35.307852 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0ab4d10e-243b-4ed5-8263-6b0073cd2eac tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:35.313648 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ab4d10e-243b-4ed5-8263-6b0073cd2eac tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:35.314089 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ab4d10e-243b-4ed5-8263-6b0073cd2eac tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:35.314876 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ab4d10e-243b-4ed5-8263-6b0073cd2eac tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:35.315303 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ab4d10e-243b-4ed5-8263-6b0073cd2eac tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:35.342881 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0ab4d10e-243b-4ed5-8263-6b0073cd2eac tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040426 Feb 21 01:34:35.343433 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 191/366] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:34:35 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:34:36.354052 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7c813e60-7a7f-4fbf-87f8-29125d5f35da tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:36.354959 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7c813e60-7a7f-4fbf-87f8-29125d5f35da tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:36.361778 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c813e60-7a7f-4fbf-87f8-29125d5f35da tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:36.362275 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c813e60-7a7f-4fbf-87f8-29125d5f35da tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:36.363045 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c813e60-7a7f-4fbf-87f8-29125d5f35da tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:36.363469 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c813e60-7a7f-4fbf-87f8-29125d5f35da tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:36.396713 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7c813e60-7a7f-4fbf-87f8-29125d5f35da tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046239 Feb 21 01:34:36.397493 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 176/367] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:34:36 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:34:37.408204 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-86f828aa-1a16-473e-aecf-b1c81f7989fa tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:37.409082 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-86f828aa-1a16-473e-aecf-b1c81f7989fa tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:37.415485 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86f828aa-1a16-473e-aecf-b1c81f7989fa tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:37.415929 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86f828aa-1a16-473e-aecf-b1c81f7989fa tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:37.416733 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86f828aa-1a16-473e-aecf-b1c81f7989fa tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:37.417171 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86f828aa-1a16-473e-aecf-b1c81f7989fa tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:37.450695 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-86f828aa-1a16-473e-aecf-b1c81f7989fa tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046249 Feb 21 01:34:37.451258 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 192/368] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:34:37 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:34:38.467009 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e81af1a9-54de-49bf-bc8b-935b39c48edc tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:38.468650 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e81af1a9-54de-49bf-bc8b-935b39c48edc tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:38.481425 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e81af1a9-54de-49bf-bc8b-935b39c48edc tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:38.482239 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e81af1a9-54de-49bf-bc8b-935b39c48edc tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:38.483317 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e81af1a9-54de-49bf-bc8b-935b39c48edc tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:38.486817 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e81af1a9-54de-49bf-bc8b-935b39c48edc tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:38.524180 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e81af1a9-54de-49bf-bc8b-935b39c48edc tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062351 Feb 21 01:34:38.525257 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 177/369] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:34:38 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:34:39.536066 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ac45c409-f186-40d3-9827-a7a620f899bf tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:39.537019 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ac45c409-f186-40d3-9827-a7a620f899bf tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:39.543346 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac45c409-f186-40d3-9827-a7a620f899bf tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:39.543790 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac45c409-f186-40d3-9827-a7a620f899bf tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:39.544586 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac45c409-f186-40d3-9827-a7a620f899bf tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:39.545018 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ac45c409-f186-40d3-9827-a7a620f899bf tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:39.574302 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ac45c409-f186-40d3-9827-a7a620f899bf tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041972 Feb 21 01:34:39.574850 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 193/370] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:34:39 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:34:40.562869 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-32677dbe-2ab3-4d61-8eac-3a36b9bfb963 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:34:40.563807 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-32677dbe-2ab3-4d61-8eac-3a36b9bfb963 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:40.570533 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32677dbe-2ab3-4d61-8eac-3a36b9bfb963 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:40.570976 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32677dbe-2ab3-4d61-8eac-3a36b9bfb963 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:40.571745 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32677dbe-2ab3-4d61-8eac-3a36b9bfb963 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:40.572178 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32677dbe-2ab3-4d61-8eac-3a36b9bfb963 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:40.586045 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-baf3add2-d7f4-4299-aa88-3b2b97ad0a43 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:40.586985 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-baf3add2-d7f4-4299-aa88-3b2b97ad0a43 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:40.592615 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-baf3add2-d7f4-4299-aa88-3b2b97ad0a43 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:40.593133 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-baf3add2-d7f4-4299-aa88-3b2b97ad0a43 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:40.593982 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-baf3add2-d7f4-4299-aa88-3b2b97ad0a43 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:40.594432 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-baf3add2-d7f4-4299-aa88-3b2b97ad0a43 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:40.594755 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-32677dbe-2ab3-4d61-8eac-3a36b9bfb963 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lazy-loading 'flavor' on Instance uuid c5323990-b38c-44dd-812e-e5b7b3fd1ea9 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:34:40.623356 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-baf3add2-d7f4-4299-aa88-3b2b97ad0a43 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041507 Feb 21 01:34:40.624114 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 194/371] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:34:40 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:34:40.924404 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-32677dbe-2ab3-4d61-8eac-3a36b9bfb963 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "POST /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9/action" status: 200 len: 32 microversion: 2.1 time: 0.365356 Feb 21 01:34:40.925028 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 178/372] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Feb 21 01:34:40 2022] POST /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9/action => generated 32 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 01:34:40.934272 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-72b28fed-d4de-4ada-8d94-1c757321e149 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:40.934886 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-72b28fed-d4de-4ada-8d94-1c757321e149 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:40.940737 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72b28fed-d4de-4ada-8d94-1c757321e149 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:40.941189 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72b28fed-d4de-4ada-8d94-1c757321e149 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:40.941962 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72b28fed-d4de-4ada-8d94-1c757321e149 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:40.942393 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72b28fed-d4de-4ada-8d94-1c757321e149 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:41.090563 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-72b28fed-d4de-4ada-8d94-1c757321e149 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:41.098585 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-72b28fed-d4de-4ada-8d94-1c757321e149 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1568 microversion: 2.1 time: 0.167839 Feb 21 01:34:41.099234 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 195/373] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:40 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:41.635484 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-43a1097b-7428-4033-9358-ad2d9dc4d6d9 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:41.636519 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-43a1097b-7428-4033-9358-ad2d9dc4d6d9 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:41.643073 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43a1097b-7428-4033-9358-ad2d9dc4d6d9 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:41.643559 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43a1097b-7428-4033-9358-ad2d9dc4d6d9 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:41.644332 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43a1097b-7428-4033-9358-ad2d9dc4d6d9 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:41.644793 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43a1097b-7428-4033-9358-ad2d9dc4d6d9 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:41.673616 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-43a1097b-7428-4033-9358-ad2d9dc4d6d9 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042914 Feb 21 01:34:41.674366 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 179/374] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:34:41 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:34:42.115988 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bf06a4e6-89e6-4124-940b-a4fa04ea25b4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:42.116675 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bf06a4e6-89e6-4124-940b-a4fa04ea25b4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:42.122476 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf06a4e6-89e6-4124-940b-a4fa04ea25b4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:42.122920 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf06a4e6-89e6-4124-940b-a4fa04ea25b4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:42.123686 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf06a4e6-89e6-4124-940b-a4fa04ea25b4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:42.124117 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bf06a4e6-89e6-4124-940b-a4fa04ea25b4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:42.253340 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-bf06a4e6-89e6-4124-940b-a4fa04ea25b4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:42.261824 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bf06a4e6-89e6-4124-940b-a4fa04ea25b4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1568 microversion: 2.1 time: 0.149800 Feb 21 01:34:42.262388 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 196/375] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:42 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:42.685949 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cab5281a-5e9a-46c1-a640-2e81225612c8 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:42.689652 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cab5281a-5e9a-46c1-a640-2e81225612c8 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:42.693095 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cab5281a-5e9a-46c1-a640-2e81225612c8 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:42.693869 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cab5281a-5e9a-46c1-a640-2e81225612c8 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:42.695800 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cab5281a-5e9a-46c1-a640-2e81225612c8 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:42.696235 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cab5281a-5e9a-46c1-a640-2e81225612c8 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:42.724910 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cab5281a-5e9a-46c1-a640-2e81225612c8 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043155 Feb 21 01:34:42.725471 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 180/376] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:34:42 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:34:43.278689 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7f9d4e99-3059-4659-a89b-926218cbce99 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:43.279225 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7f9d4e99-3059-4659-a89b-926218cbce99 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:43.284905 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f9d4e99-3059-4659-a89b-926218cbce99 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:43.285349 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f9d4e99-3059-4659-a89b-926218cbce99 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:43.286113 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f9d4e99-3059-4659-a89b-926218cbce99 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:43.286541 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7f9d4e99-3059-4659-a89b-926218cbce99 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:43.419611 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-7f9d4e99-3059-4659-a89b-926218cbce99 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:43.427731 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7f9d4e99-3059-4659-a89b-926218cbce99 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1568 microversion: 2.1 time: 0.152750 Feb 21 01:34:43.428292 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 197/377] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:43 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:43.737290 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e1b4e590-713d-4d90-a92e-8a9383fb7077 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:43.738202 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e1b4e590-713d-4d90-a92e-8a9383fb7077 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:43.744582 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1b4e590-713d-4d90-a92e-8a9383fb7077 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:43.744885 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1b4e590-713d-4d90-a92e-8a9383fb7077 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:43.745714 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1b4e590-713d-4d90-a92e-8a9383fb7077 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:43.746147 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1b4e590-713d-4d90-a92e-8a9383fb7077 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:43.781337 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e1b4e590-713d-4d90-a92e-8a9383fb7077 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048167 Feb 21 01:34:43.782027 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 181/378] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:34:43 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:34:44.444578 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b26c1d10-d44d-44df-8616-8d57ab8bb352 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:44.445333 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b26c1d10-d44d-44df-8616-8d57ab8bb352 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:44.451417 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b26c1d10-d44d-44df-8616-8d57ab8bb352 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:44.451945 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b26c1d10-d44d-44df-8616-8d57ab8bb352 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:44.452941 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b26c1d10-d44d-44df-8616-8d57ab8bb352 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:44.453503 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b26c1d10-d44d-44df-8616-8d57ab8bb352 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:44.606653 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b26c1d10-d44d-44df-8616-8d57ab8bb352 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:44.614561 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b26c1d10-d44d-44df-8616-8d57ab8bb352 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1568 microversion: 2.1 time: 0.173723 Feb 21 01:34:44.615128 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 198/379] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:44 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:44.793263 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-06168032-43f7-478c-8ebb-eda640fcdc6f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:44.794176 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-06168032-43f7-478c-8ebb-eda640fcdc6f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:44.800445 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-06168032-43f7-478c-8ebb-eda640fcdc6f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:44.800911 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-06168032-43f7-478c-8ebb-eda640fcdc6f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:44.801687 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-06168032-43f7-478c-8ebb-eda640fcdc6f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:44.802122 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-06168032-43f7-478c-8ebb-eda640fcdc6f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:44.831631 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-06168032-43f7-478c-8ebb-eda640fcdc6f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042596 Feb 21 01:34:44.832205 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 182/380] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:34:44 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 01:34:44.983283 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5f797e8c-f6a1-4790-9280-2ad236bac18d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1382843038", "imageRef": "35936a71-5ec3-4154-b01a-f2dafd8c0364", "flavorRef": "452", "networks": [{"uuid": "19c3a3ee-4943-4cb3-b92f-e4a4ed0d979a"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:34:45.032673 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-5f797e8c-f6a1-4790-9280-2ad236bac18d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] validate_networks() for [('19c3a3ee-4943-4cb3-b92f-e4a4ed0d979a', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:34:45.388961 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-5f797e8c-f6a1-4790-9280-2ad236bac18d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:34:45.389373 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-5f797e8c-f6a1-4790-9280-2ad236bac18d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:34:45.389838 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-5f797e8c-f6a1-4790-9280-2ad236bac18d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:34:45.390232 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-5f797e8c-f6a1-4790-9280-2ad236bac18d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:34:45.390630 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-5f797e8c-f6a1-4790-9280-2ad236bac18d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:34:45.398876 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f797e8c-f6a1-4790-9280-2ad236bac18d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:45.399309 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f797e8c-f6a1-4790-9280-2ad236bac18d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:45.400101 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f797e8c-f6a1-4790-9280-2ad236bac18d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:45.400558 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f797e8c-f6a1-4790-9280-2ad236bac18d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:45.416677 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-5f797e8c-f6a1-4790-9280-2ad236bac18d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Getting quotas for project 11d99a6bb8ad42a980e51a57fcec7315. Resources: {'ram', 'cores', 'instances'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:34:45.420396 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-5f797e8c-f6a1-4790-9280-2ad236bac18d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Getting quotas for user 35d4828335a543758d1413c0276657a6 and project 11d99a6bb8ad42a980e51a57fcec7315. Resources: {'ram', 'cores', 'instances'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:34:45.431137 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5f797e8c-f6a1-4790-9280-2ad236bac18d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:34:45.433403 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5f797e8c-f6a1-4790-9280-2ad236bac18d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35936a71-5ec3-4154-b01a-f2dafd8c0364',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:34:45.573565 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5f797e8c-f6a1-4790-9280-2ad236bac18d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593796 Feb 21 01:34:45.574222 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 199/381] 10.222.0.90 () {60 vars in 1146 bytes} [Mon Feb 21 01:34:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:34:45.583886 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4b424dfb-a7b4-4e78-91e4-7396f0b508d0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:45.584530 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4b424dfb-a7b4-4e78-91e4-7396f0b508d0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:45.630812 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8f4264e0-9a4c-48ed-8f6a-294cccd90eca tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:45.631511 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8f4264e0-9a4c-48ed-8f6a-294cccd90eca tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:45.638428 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-4b424dfb-a7b4-4e78-91e4-7396f0b508d0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:45.639260 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f4264e0-9a4c-48ed-8f6a-294cccd90eca tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:45.639713 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f4264e0-9a4c-48ed-8f6a-294cccd90eca tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:45.640635 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f4264e0-9a4c-48ed-8f6a-294cccd90eca tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:45.641796 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8f4264e0-9a4c-48ed-8f6a-294cccd90eca tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:45.648449 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4b424dfb-a7b4-4e78-91e4-7396f0b508d0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 200 len: 1218 microversion: 2.1 time: 0.068042 Feb 21 01:34:45.649372 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 183/382] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:45 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:45.795030 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-8f4264e0-9a4c-48ed-8f6a-294cccd90eca tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:45.802752 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8f4264e0-9a4c-48ed-8f6a-294cccd90eca tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1568 microversion: 2.1 time: 0.175653 Feb 21 01:34:45.803312 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 200/383] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:45 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:34:46.664705 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c06964c8-4c5d-468f-bd37-818ff0b9b1a7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:46.665325 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c06964c8-4c5d-468f-bd37-818ff0b9b1a7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:46.671705 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c06964c8-4c5d-468f-bd37-818ff0b9b1a7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:46.672154 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c06964c8-4c5d-468f-bd37-818ff0b9b1a7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:46.672971 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c06964c8-4c5d-468f-bd37-818ff0b9b1a7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:46.673406 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c06964c8-4c5d-468f-bd37-818ff0b9b1a7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:46.732189 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c06964c8-4c5d-468f-bd37-818ff0b9b1a7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:46.739320 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c06964c8-4c5d-468f-bd37-818ff0b9b1a7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 200 len: 1222 microversion: 2.1 time: 0.078371 Feb 21 01:34:46.739883 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 184/384] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:46 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 1222 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:46.822742 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-18827692-50fa-43bb-b8b9-ee6dee746942 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:46.823428 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-18827692-50fa-43bb-b8b9-ee6dee746942 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:46.829290 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18827692-50fa-43bb-b8b9-ee6dee746942 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:46.829743 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18827692-50fa-43bb-b8b9-ee6dee746942 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:46.830516 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18827692-50fa-43bb-b8b9-ee6dee746942 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:46.830952 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-18827692-50fa-43bb-b8b9-ee6dee746942 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:46.961014 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-18827692-50fa-43bb-b8b9-ee6dee746942 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:46.968632 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-18827692-50fa-43bb-b8b9-ee6dee746942 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1568 microversion: 2.1 time: 0.150372 Feb 21 01:34:46.969191 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 201/385] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:46 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:47.755622 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-022ef9be-5d10-46fa-81a9-ef8abea28443 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:47.756199 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-022ef9be-5d10-46fa-81a9-ef8abea28443 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:47.763843 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-022ef9be-5d10-46fa-81a9-ef8abea28443 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:47.764376 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-022ef9be-5d10-46fa-81a9-ef8abea28443 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:47.765213 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-022ef9be-5d10-46fa-81a9-ef8abea28443 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:47.765746 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-022ef9be-5d10-46fa-81a9-ef8abea28443 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:47.826316 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-022ef9be-5d10-46fa-81a9-ef8abea28443 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:47.833608 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-022ef9be-5d10-46fa-81a9-ef8abea28443 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 200 len: 1222 microversion: 2.1 time: 0.081828 Feb 21 01:34:47.834174 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 185/386] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:47 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:47.985001 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ace15c1d-73c2-42e0-b523-c1c898bf9f2c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:47.985608 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ace15c1d-73c2-42e0-b523-c1c898bf9f2c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:47.991282 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ace15c1d-73c2-42e0-b523-c1c898bf9f2c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:47.991727 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ace15c1d-73c2-42e0-b523-c1c898bf9f2c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:47.992585 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ace15c1d-73c2-42e0-b523-c1c898bf9f2c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:47.993020 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ace15c1d-73c2-42e0-b523-c1c898bf9f2c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:48.119630 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-ace15c1d-73c2-42e0-b523-c1c898bf9f2c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:48.127193 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ace15c1d-73c2-42e0-b523-c1c898bf9f2c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1568 microversion: 2.1 time: 0.145761 Feb 21 01:34:48.127757 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 202/387] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:47 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:48.850662 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-95eb171d-d3fb-4279-98f4-15801c036d0c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:48.851934 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-95eb171d-d3fb-4279-98f4-15801c036d0c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:48.858165 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95eb171d-d3fb-4279-98f4-15801c036d0c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:48.858678 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95eb171d-d3fb-4279-98f4-15801c036d0c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:48.859438 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95eb171d-d3fb-4279-98f4-15801c036d0c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:48.859874 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-95eb171d-d3fb-4279-98f4-15801c036d0c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:48.920509 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-95eb171d-d3fb-4279-98f4-15801c036d0c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:48.927776 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-95eb171d-d3fb-4279-98f4-15801c036d0c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 200 len: 1214 microversion: 2.1 time: 0.080749 Feb 21 01:34:48.928338 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 186/388] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:48 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:49.144617 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ad3e017d-c2e4-4afc-8650-bdc82db8b362 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:49.145157 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ad3e017d-c2e4-4afc-8650-bdc82db8b362 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:49.152046 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad3e017d-c2e4-4afc-8650-bdc82db8b362 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:49.152554 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad3e017d-c2e4-4afc-8650-bdc82db8b362 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:49.153336 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad3e017d-c2e4-4afc-8650-bdc82db8b362 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:49.153770 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ad3e017d-c2e4-4afc-8650-bdc82db8b362 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:49.286520 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-ad3e017d-c2e4-4afc-8650-bdc82db8b362 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:49.294760 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ad3e017d-c2e4-4afc-8650-bdc82db8b362 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1568 microversion: 2.1 time: 0.153842 Feb 21 01:34:49.295323 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 203/389] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:49 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:49.946326 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3f6d41a5-d25f-44aa-bc6d-2032184ed474 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:49.947435 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3f6d41a5-d25f-44aa-bc6d-2032184ed474 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:49.954487 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f6d41a5-d25f-44aa-bc6d-2032184ed474 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:49.954764 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f6d41a5-d25f-44aa-bc6d-2032184ed474 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:49.955718 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f6d41a5-d25f-44aa-bc6d-2032184ed474 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:49.956174 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f6d41a5-d25f-44aa-bc6d-2032184ed474 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:50.028252 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-3f6d41a5-d25f-44aa-bc6d-2032184ed474 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:50.039962 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3f6d41a5-d25f-44aa-bc6d-2032184ed474 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 200 len: 1214 microversion: 2.1 time: 0.095613 Feb 21 01:34:50.040566 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 187/390] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:49 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:50.312068 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-727b2d29-439d-4552-a125-1c8f3d9bdd27 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:50.312646 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-727b2d29-439d-4552-a125-1c8f3d9bdd27 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:50.319265 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-727b2d29-439d-4552-a125-1c8f3d9bdd27 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:50.319730 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-727b2d29-439d-4552-a125-1c8f3d9bdd27 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:50.321053 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-727b2d29-439d-4552-a125-1c8f3d9bdd27 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:50.321493 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-727b2d29-439d-4552-a125-1c8f3d9bdd27 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:50.457524 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-727b2d29-439d-4552-a125-1c8f3d9bdd27 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:50.466034 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-727b2d29-439d-4552-a125-1c8f3d9bdd27 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1568 microversion: 2.1 time: 0.157872 Feb 21 01:34:50.466596 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 204/391] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:50 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:51.060067 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b89c7d94-977d-41f7-a143-7481579c45b1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:51.060813 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b89c7d94-977d-41f7-a143-7481579c45b1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:51.071555 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89c7d94-977d-41f7-a143-7481579c45b1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:51.072017 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89c7d94-977d-41f7-a143-7481579c45b1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:51.072849 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89c7d94-977d-41f7-a143-7481579c45b1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:51.073279 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b89c7d94-977d-41f7-a143-7481579c45b1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:51.147715 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-b89c7d94-977d-41f7-a143-7481579c45b1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:51.157784 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b89c7d94-977d-41f7-a143-7481579c45b1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 200 len: 1288 microversion: 2.1 time: 0.104007 Feb 21 01:34:51.158358 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 188/392] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:51 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 1288 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:51.488889 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-62355de1-2b09-44ab-a89a-e046e7bb18cb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:51.488889 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-62355de1-2b09-44ab-a89a-e046e7bb18cb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:51.491948 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62355de1-2b09-44ab-a89a-e046e7bb18cb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:51.492392 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62355de1-2b09-44ab-a89a-e046e7bb18cb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:51.493203 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62355de1-2b09-44ab-a89a-e046e7bb18cb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:51.493629 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-62355de1-2b09-44ab-a89a-e046e7bb18cb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:51.685419 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-62355de1-2b09-44ab-a89a-e046e7bb18cb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:51.693913 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-62355de1-2b09-44ab-a89a-e046e7bb18cb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1568 microversion: 2.1 time: 0.212202 Feb 21 01:34:51.703771 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 205/393] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:51 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:52.176697 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0344764c-f5f7-4774-9554-0e9d905999d7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:52.177309 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0344764c-f5f7-4774-9554-0e9d905999d7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:52.183643 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0344764c-f5f7-4774-9554-0e9d905999d7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:52.184124 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0344764c-f5f7-4774-9554-0e9d905999d7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:52.184966 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0344764c-f5f7-4774-9554-0e9d905999d7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:52.185400 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0344764c-f5f7-4774-9554-0e9d905999d7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:52.406109 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-0344764c-f5f7-4774-9554-0e9d905999d7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:52.413369 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0344764c-f5f7-4774-9554-0e9d905999d7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 200 len: 1318 microversion: 2.1 time: 0.240286 Feb 21 01:34:52.414575 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 189/394] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:52 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:52.577864 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-453b3049-d411-403b-8685-4aa984051508 req-a8d3280b-413f-4f86-8838-024bde9c117e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0f418ad-1f7d-439b-9608-bce7843145bf", "tag": "1380c780-b46b-46e4-bbc5-6e5da903c785"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:34:52.579429 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:34:52.579429 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:34:52.587018 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-453b3049-d411-403b-8685-4aa984051508 req-a8d3280b-413f-4f86-8838-024bde9c117e service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:52.587377 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-453b3049-d411-403b-8685-4aa984051508 req-a8d3280b-413f-4f86-8838-024bde9c117e service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:52.599186 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-453b3049-d411-403b-8685-4aa984051508 req-a8d3280b-413f-4f86-8838-024bde9c117e service nova] Creating event network-changed:1380c780-b46b-46e4-bbc5-6e5da903c785 for instance c0f418ad-1f7d-439b-9608-bce7843145bf on hv-cinder-81322 Feb 21 01:34:52.602654 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-453b3049-d411-403b-8685-4aa984051508 req-a8d3280b-413f-4f86-8838-024bde9c117e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028482 Feb 21 01:34:52.603231 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 206/395] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:34:52.710148 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3068a28b-b154-4cf2-8c99-00d562bb9db8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:52.711413 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3068a28b-b154-4cf2-8c99-00d562bb9db8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:52.717199 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3068a28b-b154-4cf2-8c99-00d562bb9db8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:52.717645 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3068a28b-b154-4cf2-8c99-00d562bb9db8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:52.718417 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3068a28b-b154-4cf2-8c99-00d562bb9db8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:52.718851 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3068a28b-b154-4cf2-8c99-00d562bb9db8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:52.958666 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-3068a28b-b154-4cf2-8c99-00d562bb9db8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:52.969514 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3068a28b-b154-4cf2-8c99-00d562bb9db8 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1568 microversion: 2.1 time: 0.262339 Feb 21 01:34:52.969818 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 190/396] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:52 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1568 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:53.432383 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f7148c46-d438-456d-86eb-e630e8b9639f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:53.433125 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f7148c46-d438-456d-86eb-e630e8b9639f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:53.442264 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7148c46-d438-456d-86eb-e630e8b9639f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:53.443080 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7148c46-d438-456d-86eb-e630e8b9639f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:53.444493 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7148c46-d438-456d-86eb-e630e8b9639f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:53.445965 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7148c46-d438-456d-86eb-e630e8b9639f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:53.816524 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-f7148c46-d438-456d-86eb-e630e8b9639f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:53.824657 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f7148c46-d438-456d-86eb-e630e8b9639f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 200 len: 1318 microversion: 2.1 time: 0.397047 Feb 21 01:34:53.825306 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 207/397] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:53 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:34:53.989424 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e739fd1a-053b-4d13-a20f-001b7bff6847 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:53.990034 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e739fd1a-053b-4d13-a20f-001b7bff6847 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:53.996886 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e739fd1a-053b-4d13-a20f-001b7bff6847 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:53.997333 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e739fd1a-053b-4d13-a20f-001b7bff6847 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:53.998103 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e739fd1a-053b-4d13-a20f-001b7bff6847 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:53.998535 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e739fd1a-053b-4d13-a20f-001b7bff6847 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:54.129157 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-e739fd1a-053b-4d13-a20f-001b7bff6847 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:54.137489 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e739fd1a-053b-4d13-a20f-001b7bff6847 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1568 microversion: 2.1 time: 0.151714 Feb 21 01:34:54.138060 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 191/398] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:53 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:54.843040 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-343d52f8-961f-42ff-a4af-b9ef48013e47 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:54.843638 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-343d52f8-961f-42ff-a4af-b9ef48013e47 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:54.849725 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-343d52f8-961f-42ff-a4af-b9ef48013e47 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:54.850230 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-343d52f8-961f-42ff-a4af-b9ef48013e47 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:54.851028 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-343d52f8-961f-42ff-a4af-b9ef48013e47 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:54.851455 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-343d52f8-961f-42ff-a4af-b9ef48013e47 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:54.980564 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-343d52f8-961f-42ff-a4af-b9ef48013e47 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:54.987694 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-343d52f8-961f-42ff-a4af-b9ef48013e47 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 200 len: 1318 microversion: 2.1 time: 0.148935 Feb 21 01:34:54.988254 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 208/399] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:54 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:34:55.154592 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f616afc8-2b52-4890-9240-d8e65df2330b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:55.155224 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f616afc8-2b52-4890-9240-d8e65df2330b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:55.161546 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f616afc8-2b52-4890-9240-d8e65df2330b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:55.161998 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f616afc8-2b52-4890-9240-d8e65df2330b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:55.162775 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f616afc8-2b52-4890-9240-d8e65df2330b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:55.163211 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f616afc8-2b52-4890-9240-d8e65df2330b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:55.311135 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-f616afc8-2b52-4890-9240-d8e65df2330b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:55.319038 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f616afc8-2b52-4890-9240-d8e65df2330b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1568 microversion: 2.1 time: 0.168073 Feb 21 01:34:55.319610 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 192/400] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:55 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:56.004104 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cd4a4495-5a0e-4fce-815d-96db42450d42 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:56.004770 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cd4a4495-5a0e-4fce-815d-96db42450d42 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:56.011521 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd4a4495-5a0e-4fce-815d-96db42450d42 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:56.011972 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd4a4495-5a0e-4fce-815d-96db42450d42 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:56.012778 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd4a4495-5a0e-4fce-815d-96db42450d42 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:56.013213 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd4a4495-5a0e-4fce-815d-96db42450d42 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:56.140730 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-cd4a4495-5a0e-4fce-815d-96db42450d42 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:56.147835 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cd4a4495-5a0e-4fce-815d-96db42450d42 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 200 len: 1318 microversion: 2.1 time: 0.147485 Feb 21 01:34:56.148400 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 209/401] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:55 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:56.335719 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-be91e7fb-f823-4522-bda6-c7523cd3a02e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:56.336300 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-be91e7fb-f823-4522-bda6-c7523cd3a02e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:56.342467 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be91e7fb-f823-4522-bda6-c7523cd3a02e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:56.342920 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be91e7fb-f823-4522-bda6-c7523cd3a02e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:56.343697 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be91e7fb-f823-4522-bda6-c7523cd3a02e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:56.344130 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-be91e7fb-f823-4522-bda6-c7523cd3a02e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:56.473917 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-be91e7fb-f823-4522-bda6-c7523cd3a02e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:56.482130 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-be91e7fb-f823-4522-bda6-c7523cd3a02e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1568 microversion: 2.1 time: 0.150229 Feb 21 01:34:56.482703 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 193/402] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:56 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:57.165148 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bc364190-c154-4b59-b16f-ec23f497b788 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:57.165782 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bc364190-c154-4b59-b16f-ec23f497b788 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:57.171760 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc364190-c154-4b59-b16f-ec23f497b788 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:57.172227 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc364190-c154-4b59-b16f-ec23f497b788 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:57.173006 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc364190-c154-4b59-b16f-ec23f497b788 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:57.173437 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bc364190-c154-4b59-b16f-ec23f497b788 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:57.302676 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-bc364190-c154-4b59-b16f-ec23f497b788 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:57.310556 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bc364190-c154-4b59-b16f-ec23f497b788 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 200 len: 1318 microversion: 2.1 time: 0.149580 Feb 21 01:34:57.311103 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 210/403] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:57 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:34:57.499580 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-53d54a55-b80b-4239-886c-f441c1a88a65 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:57.500238 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-53d54a55-b80b-4239-886c-f441c1a88a65 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:57.506580 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53d54a55-b80b-4239-886c-f441c1a88a65 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:57.507026 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53d54a55-b80b-4239-886c-f441c1a88a65 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:57.508687 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53d54a55-b80b-4239-886c-f441c1a88a65 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:57.509117 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53d54a55-b80b-4239-886c-f441c1a88a65 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:57.646146 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-53d54a55-b80b-4239-886c-f441c1a88a65 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:57.654340 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-53d54a55-b80b-4239-886c-f441c1a88a65 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1568 microversion: 2.1 time: 0.158392 Feb 21 01:34:57.654902 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 194/404] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:57 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:58.326725 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b24e8db0-4806-4f32-a5fa-1f65404bc810 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:58.327341 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b24e8db0-4806-4f32-a5fa-1f65404bc810 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:58.333309 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b24e8db0-4806-4f32-a5fa-1f65404bc810 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:58.333762 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b24e8db0-4806-4f32-a5fa-1f65404bc810 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:58.334529 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b24e8db0-4806-4f32-a5fa-1f65404bc810 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:58.334964 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b24e8db0-4806-4f32-a5fa-1f65404bc810 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:58.479151 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b24e8db0-4806-4f32-a5fa-1f65404bc810 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:58.486238 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b24e8db0-4806-4f32-a5fa-1f65404bc810 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 200 len: 1318 microversion: 2.1 time: 0.163148 Feb 21 01:34:58.486789 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 211/405] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:58 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:58.670734 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7cfc9544-a982-441f-8f64-fee909e9bb19 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:58.671598 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7cfc9544-a982-441f-8f64-fee909e9bb19 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:58.677837 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7cfc9544-a982-441f-8f64-fee909e9bb19 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:58.678283 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7cfc9544-a982-441f-8f64-fee909e9bb19 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:58.679094 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7cfc9544-a982-441f-8f64-fee909e9bb19 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:58.680166 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7cfc9544-a982-441f-8f64-fee909e9bb19 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:58.820342 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-7cfc9544-a982-441f-8f64-fee909e9bb19 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:58.828642 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7cfc9544-a982-441f-8f64-fee909e9bb19 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1568 microversion: 2.1 time: 0.161485 Feb 21 01:34:58.829525 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 195/406] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:58 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:59.503428 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-791e5205-a24a-4403-b4fa-124f42e20dc7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:59.504035 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-791e5205-a24a-4403-b4fa-124f42e20dc7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:59.511815 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-791e5205-a24a-4403-b4fa-124f42e20dc7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:59.512260 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-791e5205-a24a-4403-b4fa-124f42e20dc7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:59.514617 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-791e5205-a24a-4403-b4fa-124f42e20dc7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:59.514617 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-791e5205-a24a-4403-b4fa-124f42e20dc7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:59.654123 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-791e5205-a24a-4403-b4fa-124f42e20dc7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:34:59.661559 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-791e5205-a24a-4403-b4fa-124f42e20dc7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 200 len: 1318 microversion: 2.1 time: 0.161678 Feb 21 01:34:59.662243 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 212/407] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:59 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:34:59.846565 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-61e4b461-f15f-41a3-873b-741507f35574 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:34:59.847091 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-61e4b461-f15f-41a3-873b-741507f35574 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:34:59.853672 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61e4b461-f15f-41a3-873b-741507f35574 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:59.854119 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61e4b461-f15f-41a3-873b-741507f35574 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:59.854936 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61e4b461-f15f-41a3-873b-741507f35574 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:34:59.855387 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-61e4b461-f15f-41a3-873b-741507f35574 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:34:59.997377 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-61e4b461-f15f-41a3-873b-741507f35574 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:00.005124 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-61e4b461-f15f-41a3-873b-741507f35574 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1568 microversion: 2.1 time: 0.162703 Feb 21 01:35:00.005691 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 196/408] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:34:59 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:00.678712 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-54b570f1-06de-4b71-996d-96cd4144dec2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:00.680092 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-54b570f1-06de-4b71-996d-96cd4144dec2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:00.686351 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-54b570f1-06de-4b71-996d-96cd4144dec2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:00.686871 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-54b570f1-06de-4b71-996d-96cd4144dec2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:00.687727 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-54b570f1-06de-4b71-996d-96cd4144dec2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:00.688369 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-54b570f1-06de-4b71-996d-96cd4144dec2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:00.865372 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-54b570f1-06de-4b71-996d-96cd4144dec2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:00.873439 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-54b570f1-06de-4b71-996d-96cd4144dec2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 200 len: 1318 microversion: 2.1 time: 0.198413 Feb 21 01:35:00.873997 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 213/409] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:00 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:01.022904 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6d138330-956b-4fc2-9882-7e326c9f8eb4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:01.023697 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6d138330-956b-4fc2-9882-7e326c9f8eb4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:01.030234 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d138330-956b-4fc2-9882-7e326c9f8eb4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:01.030689 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d138330-956b-4fc2-9882-7e326c9f8eb4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:01.031477 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d138330-956b-4fc2-9882-7e326c9f8eb4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:01.031915 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6d138330-956b-4fc2-9882-7e326c9f8eb4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:01.233788 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-6d138330-956b-4fc2-9882-7e326c9f8eb4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:01.242790 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6d138330-956b-4fc2-9882-7e326c9f8eb4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1568 microversion: 2.1 time: 0.223523 Feb 21 01:35:01.252701 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 197/410] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:01 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:01.890288 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-64833e9f-4786-41e7-8bb7-be68727fee57 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:01.890992 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-64833e9f-4786-41e7-8bb7-be68727fee57 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:01.897279 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64833e9f-4786-41e7-8bb7-be68727fee57 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:01.897723 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64833e9f-4786-41e7-8bb7-be68727fee57 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:01.898505 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64833e9f-4786-41e7-8bb7-be68727fee57 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:01.898937 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64833e9f-4786-41e7-8bb7-be68727fee57 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:02.067145 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-64833e9f-4786-41e7-8bb7-be68727fee57 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:02.075709 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-64833e9f-4786-41e7-8bb7-be68727fee57 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 200 len: 1318 microversion: 2.1 time: 0.189106 Feb 21 01:35:02.076398 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 214/411] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:01 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:02.259161 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ab89a014-5046-4952-8fe9-46e6684d4b5d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:02.259811 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ab89a014-5046-4952-8fe9-46e6684d4b5d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:02.266588 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab89a014-5046-4952-8fe9-46e6684d4b5d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:02.267162 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab89a014-5046-4952-8fe9-46e6684d4b5d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:02.268030 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab89a014-5046-4952-8fe9-46e6684d4b5d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:02.268572 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab89a014-5046-4952-8fe9-46e6684d4b5d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:02.517441 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ab89a014-5046-4952-8fe9-46e6684d4b5d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:02.527898 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ab89a014-5046-4952-8fe9-46e6684d4b5d tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1568 microversion: 2.1 time: 0.272601 Feb 21 01:35:02.528876 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 198/412] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:02 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1568 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:03.093466 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c19d4283-0da0-4a6a-a57c-a818727bffcd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:03.095484 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c19d4283-0da0-4a6a-a57c-a818727bffcd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:03.101907 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c19d4283-0da0-4a6a-a57c-a818727bffcd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:03.102594 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c19d4283-0da0-4a6a-a57c-a818727bffcd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:03.103443 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c19d4283-0da0-4a6a-a57c-a818727bffcd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:03.103944 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c19d4283-0da0-4a6a-a57c-a818727bffcd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:03.548250 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f5d7af40-dbb8-4b9b-a3f4-6528fedbc395 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:03.553625 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f5d7af40-dbb8-4b9b-a3f4-6528fedbc395 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:03.557807 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5d7af40-dbb8-4b9b-a3f4-6528fedbc395 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:03.558550 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5d7af40-dbb8-4b9b-a3f4-6528fedbc395 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:03.559557 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5d7af40-dbb8-4b9b-a3f4-6528fedbc395 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:03.560197 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f5d7af40-dbb8-4b9b-a3f4-6528fedbc395 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:03.564373 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-c19d4283-0da0-4a6a-a57c-a818727bffcd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:03.582429 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c19d4283-0da0-4a6a-a57c-a818727bffcd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 200 len: 1318 microversion: 2.1 time: 0.492777 Feb 21 01:35:03.592319 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 215/413] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:03 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 1318 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:03.837427 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-f5d7af40-dbb8-4b9b-a3f4-6528fedbc395 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:03.845451 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f5d7af40-dbb8-4b9b-a3f4-6528fedbc395 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1568 microversion: 2.1 time: 0.304029 Feb 21 01:35:03.846282 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 199/414] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:03 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1568 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:04.259820 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-5d688fa0-a2e4-4106-8531-2e44543c93c3 req-27d5ecfa-c831-4468-9beb-616c7b8370c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f418ad-1f7d-439b-9608-bce7843145bf", "name": "network-vif-plugged", "status": "completed", "tag": "1380c780-b46b-46e4-bbc5-6e5da903c785"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:35:04.261446 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:35:04.261446 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:35:04.268530 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5d688fa0-a2e4-4106-8531-2e44543c93c3 req-27d5ecfa-c831-4468-9beb-616c7b8370c4 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:04.269207 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-5d688fa0-a2e4-4106-8531-2e44543c93c3 req-27d5ecfa-c831-4468-9beb-616c7b8370c4 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:04.280851 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-5d688fa0-a2e4-4106-8531-2e44543c93c3 req-27d5ecfa-c831-4468-9beb-616c7b8370c4 service nova] Creating event network-vif-plugged:1380c780-b46b-46e4-bbc5-6e5da903c785 for instance c0f418ad-1f7d-439b-9608-bce7843145bf on hv-cinder-81322 Feb 21 01:35:04.286319 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-5d688fa0-a2e4-4106-8531-2e44543c93c3 req-27d5ecfa-c831-4468-9beb-616c7b8370c4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031551 Feb 21 01:35:04.287291 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 216/415] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:35:04.599543 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4f941812-ffa0-4f1a-9292-a411a502a852 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:04.600163 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4f941812-ffa0-4f1a-9292-a411a502a852 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:04.607383 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f941812-ffa0-4f1a-9292-a411a502a852 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:04.607839 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f941812-ffa0-4f1a-9292-a411a502a852 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:04.608659 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f941812-ffa0-4f1a-9292-a411a502a852 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:04.609098 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f941812-ffa0-4f1a-9292-a411a502a852 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:04.864182 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ecc60a65-c3d0-4f88-87f8-3d146143e0e6 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:04.865126 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ecc60a65-c3d0-4f88-87f8-3d146143e0e6 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:04.871812 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ecc60a65-c3d0-4f88-87f8-3d146143e0e6 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:04.872515 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ecc60a65-c3d0-4f88-87f8-3d146143e0e6 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:04.873481 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ecc60a65-c3d0-4f88-87f8-3d146143e0e6 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:04.874067 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ecc60a65-c3d0-4f88-87f8-3d146143e0e6 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:04.888941 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-4f941812-ffa0-4f1a-9292-a411a502a852 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:04.901137 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4f941812-ffa0-4f1a-9292-a411a502a852 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 200 len: 1318 microversion: 2.1 time: 0.305114 Feb 21 01:35:04.902893 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 200/416] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:04 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:05.130568 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-ecc60a65-c3d0-4f88-87f8-3d146143e0e6 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:05.139694 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ecc60a65-c3d0-4f88-87f8-3d146143e0e6 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1568 microversion: 2.1 time: 0.280745 Feb 21 01:35:05.148562 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 217/417] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:04 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1568 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:35:05.929609 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-70376b61-89eb-4632-8e66-29fc4f89dcec tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:05.930418 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-70376b61-89eb-4632-8e66-29fc4f89dcec tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:05.936693 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70376b61-89eb-4632-8e66-29fc4f89dcec tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:05.937348 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70376b61-89eb-4632-8e66-29fc4f89dcec tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:05.938116 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70376b61-89eb-4632-8e66-29fc4f89dcec tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:05.938544 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-70376b61-89eb-4632-8e66-29fc4f89dcec tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:06.144685 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-70376b61-89eb-4632-8e66-29fc4f89dcec tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:06.154059 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-70376b61-89eb-4632-8e66-29fc4f89dcec tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 200 len: 1318 microversion: 2.1 time: 0.238254 Feb 21 01:35:06.157277 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-25eb1604-c430-4563-87f8-03e60a8ad8df tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:06.161006 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-25eb1604-c430-4563-87f8-03e60a8ad8df tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:06.164921 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 201/418] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:05 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:06.176710 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25eb1604-c430-4563-87f8-03e60a8ad8df tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:06.177342 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25eb1604-c430-4563-87f8-03e60a8ad8df tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:06.178210 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25eb1604-c430-4563-87f8-03e60a8ad8df tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:06.186419 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-25eb1604-c430-4563-87f8-03e60a8ad8df tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:06.392049 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-25eb1604-c430-4563-87f8-03e60a8ad8df tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:06.403934 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-25eb1604-c430-4563-87f8-03e60a8ad8df tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1568 microversion: 2.1 time: 0.251676 Feb 21 01:35:06.404546 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 218/419] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:06 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:35:07.171520 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a28867e2-229f-4071-9b8d-58de3e7a156c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:07.172128 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a28867e2-229f-4071-9b8d-58de3e7a156c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:07.177972 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a28867e2-229f-4071-9b8d-58de3e7a156c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:07.178410 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a28867e2-229f-4071-9b8d-58de3e7a156c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:07.180970 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a28867e2-229f-4071-9b8d-58de3e7a156c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:07.180970 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a28867e2-229f-4071-9b8d-58de3e7a156c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:07.349696 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-a28867e2-229f-4071-9b8d-58de3e7a156c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:07.359202 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a28867e2-229f-4071-9b8d-58de3e7a156c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 200 len: 1318 microversion: 2.1 time: 0.191905 Feb 21 01:35:07.364383 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 202/420] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:07 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:07.421634 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-16c02a99-b909-4a9b-9a60-7b5de267b295 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:07.424741 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-16c02a99-b909-4a9b-9a60-7b5de267b295 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:07.438353 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16c02a99-b909-4a9b-9a60-7b5de267b295 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:07.438911 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16c02a99-b909-4a9b-9a60-7b5de267b295 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:07.439695 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16c02a99-b909-4a9b-9a60-7b5de267b295 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:07.442733 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-16c02a99-b909-4a9b-9a60-7b5de267b295 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:07.594361 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-16c02a99-b909-4a9b-9a60-7b5de267b295 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:07.602719 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-16c02a99-b909-4a9b-9a60-7b5de267b295 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1568 microversion: 2.1 time: 0.184833 Feb 21 01:35:07.603384 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 219/421] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:07 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:08.378226 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ccddd55b-f4bc-404d-8b02-b376b1d29856 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:08.380142 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ccddd55b-f4bc-404d-8b02-b376b1d29856 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:08.395557 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ccddd55b-f4bc-404d-8b02-b376b1d29856 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:08.396013 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ccddd55b-f4bc-404d-8b02-b376b1d29856 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:08.396846 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ccddd55b-f4bc-404d-8b02-b376b1d29856 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:08.397274 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ccddd55b-f4bc-404d-8b02-b376b1d29856 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:08.561485 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ccddd55b-f4bc-404d-8b02-b376b1d29856 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:08.569054 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ccddd55b-f4bc-404d-8b02-b376b1d29856 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 200 len: 1318 microversion: 2.1 time: 0.195614 Feb 21 01:35:08.570370 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 203/422] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:08 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:08.620981 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-30c59c78-1389-4124-a8aa-3469702241fd tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:08.621708 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-30c59c78-1389-4124-a8aa-3469702241fd tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:08.628840 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30c59c78-1389-4124-a8aa-3469702241fd tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:08.629289 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30c59c78-1389-4124-a8aa-3469702241fd tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:08.630079 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30c59c78-1389-4124-a8aa-3469702241fd tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:08.630513 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30c59c78-1389-4124-a8aa-3469702241fd tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:08.821251 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-30c59c78-1389-4124-a8aa-3469702241fd tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:08.851107 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-30c59c78-1389-4124-a8aa-3469702241fd tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1568 microversion: 2.1 time: 0.233650 Feb 21 01:35:08.861643 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 220/423] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:08 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:09.587761 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-def44c8f-a93e-44e1-b307-a1d102492867 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:09.588257 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-def44c8f-a93e-44e1-b307-a1d102492867 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:09.596457 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-def44c8f-a93e-44e1-b307-a1d102492867 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:09.596915 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-def44c8f-a93e-44e1-b307-a1d102492867 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:09.597752 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-def44c8f-a93e-44e1-b307-a1d102492867 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:09.598189 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-def44c8f-a93e-44e1-b307-a1d102492867 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:09.869831 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fb728052-eec6-4afd-9db8-ea26263b0e91 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:09.869831 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fb728052-eec6-4afd-9db8-ea26263b0e91 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:09.879848 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb728052-eec6-4afd-9db8-ea26263b0e91 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:09.880356 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb728052-eec6-4afd-9db8-ea26263b0e91 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:09.881209 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb728052-eec6-4afd-9db8-ea26263b0e91 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:09.881640 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fb728052-eec6-4afd-9db8-ea26263b0e91 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:10.045796 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-def44c8f-a93e-44e1-b307-a1d102492867 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:10.061734 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-def44c8f-a93e-44e1-b307-a1d102492867 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 200 len: 1508 microversion: 2.1 time: 0.477356 Feb 21 01:35:10.065448 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 204/424] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:09 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 1508 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:10.305499 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-fb728052-eec6-4afd-9db8-ea26263b0e91 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:10.320268 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fb728052-eec6-4afd-9db8-ea26263b0e91 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1568 microversion: 2.1 time: 0.455846 Feb 21 01:35:10.321189 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 221/425] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:09 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1568 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:11.340916 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fcb6c677-16d7-43ba-9cbf-ea86dcd02cfc tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:11.341630 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fcb6c677-16d7-43ba-9cbf-ea86dcd02cfc tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:11.348539 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fcb6c677-16d7-43ba-9cbf-ea86dcd02cfc tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:11.349400 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fcb6c677-16d7-43ba-9cbf-ea86dcd02cfc tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:11.350380 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fcb6c677-16d7-43ba-9cbf-ea86dcd02cfc tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:11.351475 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fcb6c677-16d7-43ba-9cbf-ea86dcd02cfc tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:11.695501 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-fcb6c677-16d7-43ba-9cbf-ea86dcd02cfc tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:11.706783 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fcb6c677-16d7-43ba-9cbf-ea86dcd02cfc tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1568 microversion: 2.1 time: 0.372242 Feb 21 01:35:11.708383 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 205/426] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:11 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1568 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:35:12.737767 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2314a507-e980-43bb-a776-474a6fec4d55 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:12.738440 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2314a507-e980-43bb-a776-474a6fec4d55 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:12.745746 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2314a507-e980-43bb-a776-474a6fec4d55 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:12.746181 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2314a507-e980-43bb-a776-474a6fec4d55 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:12.746951 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2314a507-e980-43bb-a776-474a6fec4d55 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:12.747372 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2314a507-e980-43bb-a776-474a6fec4d55 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:12.892022 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2314a507-e980-43bb-a776-474a6fec4d55 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:12.900141 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2314a507-e980-43bb-a776-474a6fec4d55 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1548 microversion: 2.1 time: 0.179326 Feb 21 01:35:12.901551 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 222/427] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:12 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1548 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:12.918159 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-619962e8-28ff-4d7f-a934-e12394f5655f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:12.918649 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-619962e8-28ff-4d7f-a934-e12394f5655f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:12.922497 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-355481e4-002c-4511-bd6b-08545eff2954 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a482729-17ca-47ba-8656-f15ddb9af95d"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:35:12.923764 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-355481e4-002c-4511-bd6b-08545eff2954 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:12.924620 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-619962e8-28ff-4d7f-a934-e12394f5655f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:12.925068 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-619962e8-28ff-4d7f-a934-e12394f5655f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:12.925844 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-619962e8-28ff-4d7f-a934-e12394f5655f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:12.926269 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-619962e8-28ff-4d7f-a934-e12394f5655f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:12.932719 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-355481e4-002c-4511-bd6b-08545eff2954 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:12.933259 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-355481e4-002c-4511-bd6b-08545eff2954 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:12.934823 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-355481e4-002c-4511-bd6b-08545eff2954 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:12.935337 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-355481e4-002c-4511-bd6b-08545eff2954 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:13.016376 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-619962e8-28ff-4d7f-a934-e12394f5655f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] HTTP exception thrown: Cannot 'detach_volume' instance c5323990-b38c-44dd-812e-e5b7b3fd1ea9 while it is in vm_state rescued Feb 21 01:35:13.017060 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-619962e8-28ff-4d7f-a934-e12394f5655f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Returning 409 to user: Cannot 'detach_volume' instance c5323990-b38c-44dd-812e-e5b7b3fd1ea9 while it is in vm_state rescued {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:35:13.017950 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-619962e8-28ff-4d7f-a934-e12394f5655f tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "DELETE /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9/os-volume_attachments/eda42a2d-2d9c-4389-89f2-2b9608ce0cd6" status: 409 len: 152 microversion: 2.1 time: 0.103541 Feb 21 01:35:13.018589 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 223/428] 10.222.0.90 () {58 vars in 1415 bytes} [Mon Feb 21 01:35:12 2022] DELETE /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9/os-volume_attachments/eda42a2d-2d9c-4389-89f2-2b9608ce0cd6 => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Feb 21 01:35:13.031026 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2cfc284a-4f44-4a4f-b680-84b55d69ae35 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:35:13.032875 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2cfc284a-4f44-4a4f-b680-84b55d69ae35 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:13.046748 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2cfc284a-4f44-4a4f-b680-84b55d69ae35 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:13.047246 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2cfc284a-4f44-4a4f-b680-84b55d69ae35 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:13.053479 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2cfc284a-4f44-4a4f-b680-84b55d69ae35 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:13.054584 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2cfc284a-4f44-4a4f-b680-84b55d69ae35 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:13.244746 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2cfc284a-4f44-4a4f-b680-84b55d69ae35 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "POST /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9/action" status: 202 len: 0 microversion: 2.1 time: 0.221200 Feb 21 01:35:13.253683 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 224/429] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Feb 21 01:35:13 2022] POST /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 21 01:35:13.255339 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-767f08a2-0860-48b4-b4da-7ac99ed120a1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:13.256048 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-767f08a2-0860-48b4-b4da-7ac99ed120a1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:13.263680 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-767f08a2-0860-48b4-b4da-7ac99ed120a1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:13.265300 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-767f08a2-0860-48b4-b4da-7ac99ed120a1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:13.266131 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-767f08a2-0860-48b4-b4da-7ac99ed120a1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:13.266722 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-767f08a2-0860-48b4-b4da-7ac99ed120a1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:13.564282 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-767f08a2-0860-48b4-b4da-7ac99ed120a1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:13.578507 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-767f08a2-0860-48b4-b4da-7ac99ed120a1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1556 microversion: 2.1 time: 0.327654 Feb 21 01:35:13.588541 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 225/430] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:13 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1556 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:13.716051 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-355481e4-002c-4511-bd6b-08545eff2954 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "POST /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.799803 Feb 21 01:35:13.716774 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 206/431] 10.222.0.90 () {60 vars in 1322 bytes} [Mon Feb 21 01:35:12 2022] POST /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf/os-volume_attachments => generated 194 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:35:14.596386 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8d08cabe-7ef4-4a8e-ab19-e08b889b3d87 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:14.597891 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8d08cabe-7ef4-4a8e-ab19-e08b889b3d87 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:14.605720 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d08cabe-7ef4-4a8e-ab19-e08b889b3d87 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:14.606491 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d08cabe-7ef4-4a8e-ab19-e08b889b3d87 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:14.608280 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d08cabe-7ef4-4a8e-ab19-e08b889b3d87 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:14.608970 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d08cabe-7ef4-4a8e-ab19-e08b889b3d87 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:14.834626 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-8d08cabe-7ef4-4a8e-ab19-e08b889b3d87 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:14.845742 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8d08cabe-7ef4-4a8e-ab19-e08b889b3d87 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1556 microversion: 2.1 time: 0.252747 Feb 21 01:35:14.846880 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 226/432] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:14 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1556 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:35:15.864735 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-55dc2fb5-d8cc-4411-84b1-04cc68388e60 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:15.866872 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-55dc2fb5-d8cc-4411-84b1-04cc68388e60 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:15.876144 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55dc2fb5-d8cc-4411-84b1-04cc68388e60 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:15.876629 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55dc2fb5-d8cc-4411-84b1-04cc68388e60 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:15.877427 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55dc2fb5-d8cc-4411-84b1-04cc68388e60 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:15.877864 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-55dc2fb5-d8cc-4411-84b1-04cc68388e60 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:16.147003 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-55dc2fb5-d8cc-4411-84b1-04cc68388e60 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:16.159133 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-55dc2fb5-d8cc-4411-84b1-04cc68388e60 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1556 microversion: 2.1 time: 0.298788 Feb 21 01:35:16.160656 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 207/433] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:15 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1556 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:17.176763 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-72c1af15-6124-4997-8aba-4da06052f427 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:17.177304 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-72c1af15-6124-4997-8aba-4da06052f427 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:17.183844 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72c1af15-6124-4997-8aba-4da06052f427 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:17.184298 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72c1af15-6124-4997-8aba-4da06052f427 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:17.185122 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72c1af15-6124-4997-8aba-4da06052f427 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:17.185563 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-72c1af15-6124-4997-8aba-4da06052f427 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:17.327533 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-72c1af15-6124-4997-8aba-4da06052f427 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:17.335557 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-72c1af15-6124-4997-8aba-4da06052f427 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1556 microversion: 2.1 time: 0.162577 Feb 21 01:35:17.336118 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 227/434] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:17 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:35:18.351644 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5d6f6c92-73b7-4891-93a0-f0242b742720 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:18.352460 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5d6f6c92-73b7-4891-93a0-f0242b742720 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:18.361990 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d6f6c92-73b7-4891-93a0-f0242b742720 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:18.362435 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d6f6c92-73b7-4891-93a0-f0242b742720 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:18.368714 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d6f6c92-73b7-4891-93a0-f0242b742720 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:18.369154 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5d6f6c92-73b7-4891-93a0-f0242b742720 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:18.535522 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-5d6f6c92-73b7-4891-93a0-f0242b742720 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:18.544154 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5d6f6c92-73b7-4891-93a0-f0242b742720 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1562 microversion: 2.1 time: 0.196116 Feb 21 01:35:18.544969 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 208/435] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:18 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1562 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:18.689739 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3d310d4e-0117-455a-954b-579703ce3b21 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:18.690233 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3d310d4e-0117-455a-954b-579703ce3b21 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:18.712534 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d310d4e-0117-455a-954b-579703ce3b21 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:18.718050 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d310d4e-0117-455a-954b-579703ce3b21 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:18.719435 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d310d4e-0117-455a-954b-579703ce3b21 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:18.723171 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d310d4e-0117-455a-954b-579703ce3b21 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:18.853644 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-3d310d4e-0117-455a-954b-579703ce3b21 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lazy-loading 'services' on Instance uuid c5323990-b38c-44dd-812e-e5b7b3fd1ea9 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:35:19.151212 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3d310d4e-0117-455a-954b-579703ce3b21 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "DELETE /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9/os-volume_attachments/eda42a2d-2d9c-4389-89f2-2b9608ce0cd6" status: 202 len: 0 microversion: 2.1 time: 0.475582 Feb 21 01:35:19.151212 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 228/436] 10.222.0.90 () {58 vars in 1415 bytes} [Mon Feb 21 01:35:18 2022] DELETE /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9/os-volume_attachments/eda42a2d-2d9c-4389-89f2-2b9608ce0cd6 => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:35:19.159942 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5df4b3fc-998d-46e8-a36d-bd91acd84a3b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:19.171715 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5df4b3fc-998d-46e8-a36d-bd91acd84a3b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:19.174152 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5df4b3fc-998d-46e8-a36d-bd91acd84a3b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:19.174619 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5df4b3fc-998d-46e8-a36d-bd91acd84a3b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:19.176784 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5df4b3fc-998d-46e8-a36d-bd91acd84a3b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:19.177222 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5df4b3fc-998d-46e8-a36d-bd91acd84a3b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:19.234039 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5df4b3fc-998d-46e8-a36d-bd91acd84a3b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077636 Feb 21 01:35:19.234834 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 209/437] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:35:19 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:35:20.247053 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2de89299-0aec-4c1f-bfd7-9c476a2a958b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:20.248120 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2de89299-0aec-4c1f-bfd7-9c476a2a958b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:20.259406 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2de89299-0aec-4c1f-bfd7-9c476a2a958b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:20.262062 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2de89299-0aec-4c1f-bfd7-9c476a2a958b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:20.262062 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2de89299-0aec-4c1f-bfd7-9c476a2a958b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:20.262062 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2de89299-0aec-4c1f-bfd7-9c476a2a958b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:20.297432 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2de89299-0aec-4c1f-bfd7-9c476a2a958b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054717 Feb 21 01:35:20.298685 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 229/438] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:35:20 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:35:21.311083 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-eebfb029-1529-43ab-8996-7a23e06e549a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:21.313080 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-eebfb029-1529-43ab-8996-7a23e06e549a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:21.321448 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eebfb029-1529-43ab-8996-7a23e06e549a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:21.322350 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eebfb029-1529-43ab-8996-7a23e06e549a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:21.323492 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eebfb029-1529-43ab-8996-7a23e06e549a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:21.324081 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-eebfb029-1529-43ab-8996-7a23e06e549a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:21.365369 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-eebfb029-1529-43ab-8996-7a23e06e549a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058518 Feb 21 01:35:21.371884 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 210/439] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:35:21 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:35:22.378912 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e6b30e99-96f5-4e70-91bc-2eded5d95918 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:22.384292 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e6b30e99-96f5-4e70-91bc-2eded5d95918 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:22.389309 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6b30e99-96f5-4e70-91bc-2eded5d95918 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:22.389755 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6b30e99-96f5-4e70-91bc-2eded5d95918 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:22.390550 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6b30e99-96f5-4e70-91bc-2eded5d95918 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:22.390975 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6b30e99-96f5-4e70-91bc-2eded5d95918 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:22.437511 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e6b30e99-96f5-4e70-91bc-2eded5d95918 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060922 Feb 21 01:35:22.441217 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 230/440] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:35:22 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:35:22.680086 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ae4a85a9-54b6-4a03-82fe-d30ea7037705 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:22.680606 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ae4a85a9-54b6-4a03-82fe-d30ea7037705 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:22.691999 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae4a85a9-54b6-4a03-82fe-d30ea7037705 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:22.694164 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae4a85a9-54b6-4a03-82fe-d30ea7037705 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:22.696849 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae4a85a9-54b6-4a03-82fe-d30ea7037705 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:22.698888 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ae4a85a9-54b6-4a03-82fe-d30ea7037705 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:22.831414 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-ae4a85a9-54b6-4a03-82fe-d30ea7037705 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lazy-loading 'services' on Instance uuid c0f418ad-1f7d-439b-9608-bce7843145bf {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:35:23.109776 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ae4a85a9-54b6-4a03-82fe-d30ea7037705 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "DELETE /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf/os-volume_attachments/6a482729-17ca-47ba-8656-f15ddb9af95d" status: 202 len: 0 microversion: 2.1 time: 0.435915 Feb 21 01:35:23.114016 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 211/441] 10.222.0.90 () {58 vars in 1415 bytes} [Mon Feb 21 01:35:22 2022] DELETE /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf/os-volume_attachments/6a482729-17ca-47ba-8656-f15ddb9af95d => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:35:23.118894 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-374c87d9-a319-496a-91df-6c9c4eb0b3d1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:23.120033 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-374c87d9-a319-496a-91df-6c9c4eb0b3d1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:23.131510 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-374c87d9-a319-496a-91df-6c9c4eb0b3d1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:23.131957 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-374c87d9-a319-496a-91df-6c9c4eb0b3d1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:23.132799 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-374c87d9-a319-496a-91df-6c9c4eb0b3d1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:23.133223 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-374c87d9-a319-496a-91df-6c9c4eb0b3d1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:23.205532 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-374c87d9-a319-496a-91df-6c9c4eb0b3d1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090009 Feb 21 01:35:23.207409 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 231/442] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:35:23 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:35:23.455238 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8eedd24a-a27d-4c68-9cb6-0d125716c9e1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:23.456320 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8eedd24a-a27d-4c68-9cb6-0d125716c9e1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:23.504396 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8eedd24a-a27d-4c68-9cb6-0d125716c9e1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:23.504908 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8eedd24a-a27d-4c68-9cb6-0d125716c9e1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:23.505702 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8eedd24a-a27d-4c68-9cb6-0d125716c9e1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:23.506141 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8eedd24a-a27d-4c68-9cb6-0d125716c9e1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:23.597420 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8eedd24a-a27d-4c68-9cb6-0d125716c9e1 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.149909 Feb 21 01:35:23.616227 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 212/443] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:35:23 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9/os-volume_attachments => generated 25 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 01:35:24.222733 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6434026e-fed8-421a-a17e-177f38577080 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:24.223789 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6434026e-fed8-421a-a17e-177f38577080 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:24.235435 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6434026e-fed8-421a-a17e-177f38577080 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:24.237057 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6434026e-fed8-421a-a17e-177f38577080 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:24.238186 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6434026e-fed8-421a-a17e-177f38577080 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:24.238913 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6434026e-fed8-421a-a17e-177f38577080 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:24.281475 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6434026e-fed8-421a-a17e-177f38577080 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064715 Feb 21 01:35:24.289882 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 232/444] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:35:24 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:35:25.293997 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-32945beb-da5e-4a35-b7d6-50684178731f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:25.295059 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-32945beb-da5e-4a35-b7d6-50684178731f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:25.301491 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32945beb-da5e-4a35-b7d6-50684178731f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:25.301925 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32945beb-da5e-4a35-b7d6-50684178731f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:25.302683 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32945beb-da5e-4a35-b7d6-50684178731f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:25.303170 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-32945beb-da5e-4a35-b7d6-50684178731f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:25.336137 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-32945beb-da5e-4a35-b7d6-50684178731f tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045833 Feb 21 01:35:25.337567 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 213/445] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:35:25 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 01:35:26.432801 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9d1ff8b7-55aa-4db9-810a-fa2b88da6a98 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:26.433303 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9d1ff8b7-55aa-4db9-810a-fa2b88da6a98 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:26.444504 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d1ff8b7-55aa-4db9-810a-fa2b88da6a98 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:26.444959 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d1ff8b7-55aa-4db9-810a-fa2b88da6a98 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:26.445722 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d1ff8b7-55aa-4db9-810a-fa2b88da6a98 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:26.446155 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9d1ff8b7-55aa-4db9-810a-fa2b88da6a98 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:26.481078 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9d1ff8b7-55aa-4db9-810a-fa2b88da6a98 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:35:26.859247 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9d1ff8b7-55aa-4db9-810a-fa2b88da6a98 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "DELETE /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 204 len: 0 microversion: 2.1 time: 0.435094 Feb 21 01:35:26.860300 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 233/446] 10.222.0.90 () {58 vars in 1238 bytes} [Mon Feb 21 01:35:26 2022] DELETE /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:35:26.870722 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1f55b9ae-ecd3-466b-a3fd-b33108df05c5 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:26.872732 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1f55b9ae-ecd3-466b-a3fd-b33108df05c5 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:26.891526 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f55b9ae-ecd3-466b-a3fd-b33108df05c5 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:26.891974 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f55b9ae-ecd3-466b-a3fd-b33108df05c5 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:26.892798 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f55b9ae-ecd3-466b-a3fd-b33108df05c5 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:26.893227 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f55b9ae-ecd3-466b-a3fd-b33108df05c5 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:26.923625 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3713f329-dbc0-4a38-8de4-8782838a7f5b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Action: 'create', calling method: .version_select at 0x7f4075e1d4c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1847498242"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:35:26.956457 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-3713f329-dbc0-4a38-8de4-8782838a7f5b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Getting quotas for project 784f5427745d402ba47e692082aac30f. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:35:26.962776 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-3713f329-dbc0-4a38-8de4-8782838a7f5b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Getting quotas for user c250b028df424333b3a2a87b54fcaef2 and project 784f5427745d402ba47e692082aac30f. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:35:26.987400 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3713f329-dbc0-4a38-8de4-8782838a7f5b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [a0436488-2d81-40c8-bff9-bf11e082ac2c] AMQP server on 10.222.0.90:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 21 01:35:27.057119 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-1f55b9ae-ecd3-466b-a3fd-b33108df05c5 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:27.066004 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1f55b9ae-ecd3-466b-a3fd-b33108df05c5 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1507 microversion: 2.1 time: 0.201548 Feb 21 01:35:27.067182 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 214/447] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:26 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1507 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:27.072357 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7c8eea5c-f137-42a7-93ea-334af4385bcd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:27.073063 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7c8eea5c-f137-42a7-93ea-334af4385bcd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:27.079257 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c8eea5c-f137-42a7-93ea-334af4385bcd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:27.080004 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c8eea5c-f137-42a7-93ea-334af4385bcd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:27.080820 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c8eea5c-f137-42a7-93ea-334af4385bcd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:27.081246 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c8eea5c-f137-42a7-93ea-334af4385bcd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:27.106515 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7c8eea5c-f137-42a7-93ea-334af4385bcd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:35:27.457229 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7c8eea5c-f137-42a7-93ea-334af4385bcd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "DELETE /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 204 len: 0 microversion: 2.1 time: 0.388577 Feb 21 01:35:27.457812 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 215/448] 10.222.0.90 () {58 vars in 1238 bytes} [Mon Feb 21 01:35:27 2022] DELETE /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:35:27.465696 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-40b5eaa9-9a30-4436-b12e-3dc261842bff tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:27.466572 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-40b5eaa9-9a30-4436-b12e-3dc261842bff tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:27.473691 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40b5eaa9-9a30-4436-b12e-3dc261842bff tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:27.474014 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40b5eaa9-9a30-4436-b12e-3dc261842bff tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:27.475254 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40b5eaa9-9a30-4436-b12e-3dc261842bff tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:27.475690 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40b5eaa9-9a30-4436-b12e-3dc261842bff tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:27.626897 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-40b5eaa9-9a30-4436-b12e-3dc261842bff tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:27.637052 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-40b5eaa9-9a30-4436-b12e-3dc261842bff tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 200 len: 1514 microversion: 2.1 time: 0.175190 Feb 21 01:35:27.638417 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 216/449] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:27 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:27.996466 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [None req-3713f329-dbc0-4a38-8de4-8782838a7f5b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [a0436488-2d81-40c8-bff9-bf11e082ac2c] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 54958. Feb 21 01:35:28.084133 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fe43bf5b-f3f1-4105-b9d8-e7d69f284c2e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:28.088950 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fe43bf5b-f3f1-4105-b9d8-e7d69f284c2e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:28.092183 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe43bf5b-f3f1-4105-b9d8-e7d69f284c2e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:28.092843 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe43bf5b-f3f1-4105-b9d8-e7d69f284c2e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:28.093629 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe43bf5b-f3f1-4105-b9d8-e7d69f284c2e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:28.094064 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe43bf5b-f3f1-4105-b9d8-e7d69f284c2e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:28.250370 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-3713f329-dbc0-4a38-8de4-8782838a7f5b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Getting quotas for project 784f5427745d402ba47e692082aac30f. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:35:28.255032 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-3713f329-dbc0-4a38-8de4-8782838a7f5b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Getting quotas for user c250b028df424333b3a2a87b54fcaef2 and project 784f5427745d402ba47e692082aac30f. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:35:28.270458 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3713f329-dbc0-4a38-8de4-8782838a7f5b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 1.355134 Feb 21 01:35:28.281183 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 234/450] 10.222.0.90 () {60 vars in 1157 bytes} [Mon Feb 21 01:35:26 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:28.281378 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-fe43bf5b-f3f1-4105-b9d8-e7d69f284c2e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:28.285758 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fe43bf5b-f3f1-4105-b9d8-e7d69f284c2e tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1507 microversion: 2.1 time: 0.205878 Feb 21 01:35:28.287089 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 217/451] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:28 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1507 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:28.385734 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-68a1d944-2892-473a-a385-6a7312a18e6c tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-886119672", "imageRef": "7e8e7be8-74ec-4725-b032-601ed214b99b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1847498242", "networks": [{"uuid": "d421b8af-7dc1-48b3-b75d-8a9c768a3410"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:35:28.440060 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-68a1d944-2892-473a-a385-6a7312a18e6c tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] validate_networks() for [('d421b8af-7dc1-48b3-b75d-8a9c768a3410', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:35:28.654479 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0dd309de-b668-41f8-9525-3214c0596972 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:28.655314 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0dd309de-b668-41f8-9525-3214c0596972 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:28.663264 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0dd309de-b668-41f8-9525-3214c0596972 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:28.663792 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0dd309de-b668-41f8-9525-3214c0596972 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:28.665398 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0dd309de-b668-41f8-9525-3214c0596972 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:28.666357 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0dd309de-b668-41f8-9525-3214c0596972 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:28.902905 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-0dd309de-b668-41f8-9525-3214c0596972 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:28.910692 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0dd309de-b668-41f8-9525-3214c0596972 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 200 len: 1514 microversion: 2.1 time: 0.259867 Feb 21 01:35:28.920419 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 218/452] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:28 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 1514 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:29.002181 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-68a1d944-2892-473a-a385-6a7312a18e6c tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:35:29.002672 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-68a1d944-2892-473a-a385-6a7312a18e6c tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:35:29.003174 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-68a1d944-2892-473a-a385-6a7312a18e6c tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:35:29.003604 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-68a1d944-2892-473a-a385-6a7312a18e6c tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:35:29.004071 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-68a1d944-2892-473a-a385-6a7312a18e6c tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:35:29.013634 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68a1d944-2892-473a-a385-6a7312a18e6c tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:29.014076 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68a1d944-2892-473a-a385-6a7312a18e6c tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:29.014882 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68a1d944-2892-473a-a385-6a7312a18e6c tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:29.015314 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-68a1d944-2892-473a-a385-6a7312a18e6c tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:29.031924 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-68a1d944-2892-473a-a385-6a7312a18e6c tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Getting quotas for project 784f5427745d402ba47e692082aac30f. Resources: {'ram', 'cores', 'instances'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:35:29.036194 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-68a1d944-2892-473a-a385-6a7312a18e6c tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Getting quotas for user c250b028df424333b3a2a87b54fcaef2 and project 784f5427745d402ba47e692082aac30f. Resources: {'ram', 'cores', 'instances'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:35:29.055205 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-68a1d944-2892-473a-a385-6a7312a18e6c tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:35:29.057617 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-68a1d944-2892-473a-a385-6a7312a18e6c tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7e8e7be8-74ec-4725-b032-601ed214b99b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:35:29.180577 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-68a1d944-2892-473a-a385-6a7312a18e6c tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.798802 Feb 21 01:35:29.181284 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 235/453] 10.222.0.90 () {60 vars in 1146 bytes} [Mon Feb 21 01:35:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 21 01:35:29.191349 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c1098480-cd1c-4b39-a4c0-448d5368476d tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:29.191978 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c1098480-cd1c-4b39-a4c0-448d5368476d tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:29.268823 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c1098480-cd1c-4b39-a4c0-448d5368476d tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:29.277205 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c1098480-cd1c-4b39-a4c0-448d5368476d tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1258 microversion: 2.1 time: 0.089431 Feb 21 01:35:29.277792 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 219/454] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:29 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1258 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:35:29.302733 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-270473fb-56dc-4608-8f31-d4fc7b017a01 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:29.304312 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-270473fb-56dc-4608-8f31-d4fc7b017a01 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:29.315116 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-270473fb-56dc-4608-8f31-d4fc7b017a01 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:29.315669 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-270473fb-56dc-4608-8f31-d4fc7b017a01 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:29.316534 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-270473fb-56dc-4608-8f31-d4fc7b017a01 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:29.316975 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-270473fb-56dc-4608-8f31-d4fc7b017a01 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:29.501131 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-270473fb-56dc-4608-8f31-d4fc7b017a01 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:29.510762 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-270473fb-56dc-4608-8f31-d4fc7b017a01 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1507 microversion: 2.1 time: 0.211589 Feb 21 01:35:29.511540 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 236/455] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:29 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1507 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:29.928839 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a13d745a-fa84-434a-9dba-81706ef0dc71 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:29.930360 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a13d745a-fa84-434a-9dba-81706ef0dc71 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:29.938696 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a13d745a-fa84-434a-9dba-81706ef0dc71 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:29.939947 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a13d745a-fa84-434a-9dba-81706ef0dc71 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:29.940967 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a13d745a-fa84-434a-9dba-81706ef0dc71 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:29.941621 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a13d745a-fa84-434a-9dba-81706ef0dc71 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:30.293856 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7e132717-07d4-422b-addb-0932347e64c2 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:30.294659 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7e132717-07d4-422b-addb-0932347e64c2 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:30.305982 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-a13d745a-fa84-434a-9dba-81706ef0dc71 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:30.314423 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a13d745a-fa84-434a-9dba-81706ef0dc71 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 200 len: 1514 microversion: 2.1 time: 0.391026 Feb 21 01:35:30.331974 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 220/456] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:29 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 1514 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:35:30.409745 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-7e132717-07d4-422b-addb-0932347e64c2 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:30.417533 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7e132717-07d4-422b-addb-0932347e64c2 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1258 microversion: 2.1 time: 0.127311 Feb 21 01:35:30.418748 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 237/457] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:30 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1258 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:30.527416 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bd8bdfc9-d28d-49fd-a1d4-36bfa01a72eb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:30.528200 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bd8bdfc9-d28d-49fd-a1d4-36bfa01a72eb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:30.534269 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd8bdfc9-d28d-49fd-a1d4-36bfa01a72eb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:30.554551 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd8bdfc9-d28d-49fd-a1d4-36bfa01a72eb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:30.554551 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd8bdfc9-d28d-49fd-a1d4-36bfa01a72eb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:30.554551 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd8bdfc9-d28d-49fd-a1d4-36bfa01a72eb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:30.799626 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-bd8bdfc9-d28d-49fd-a1d4-36bfa01a72eb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:30.809594 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bd8bdfc9-d28d-49fd-a1d4-36bfa01a72eb tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1507 microversion: 2.1 time: 0.285775 Feb 21 01:35:30.810830 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 221/458] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:30 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1507 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:30.985762 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-a54fab7c-334a-43ea-9836-ae64ac17dd01 req-140ef34b-a8ec-41af-960f-93bdb2ea3a1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f418ad-1f7d-439b-9608-bce7843145bf", "name": "network-vif-deleted", "tag": "1380c780-b46b-46e4-bbc5-6e5da903c785"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:35:30.987312 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:35:30.987312 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:35:30.995211 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a54fab7c-334a-43ea-9836-ae64ac17dd01 req-140ef34b-a8ec-41af-960f-93bdb2ea3a1a service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:30.995662 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a54fab7c-334a-43ea-9836-ae64ac17dd01 req-140ef34b-a8ec-41af-960f-93bdb2ea3a1a service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:31.009563 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-a54fab7c-334a-43ea-9836-ae64ac17dd01 req-140ef34b-a8ec-41af-960f-93bdb2ea3a1a service nova] Creating event network-vif-deleted:1380c780-b46b-46e4-bbc5-6e5da903c785 for instance c0f418ad-1f7d-439b-9608-bce7843145bf on hv-cinder-81322 Feb 21 01:35:31.015826 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-a54fab7c-334a-43ea-9836-ae64ac17dd01 req-140ef34b-a8ec-41af-960f-93bdb2ea3a1a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033355 Feb 21 01:35:31.016969 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 238/459] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:35:31.337741 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-62304379-ffff-45d9-9011-b2a53749e6b1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:31.338720 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-62304379-ffff-45d9-9011-b2a53749e6b1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:31.350876 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62304379-ffff-45d9-9011-b2a53749e6b1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:31.354140 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62304379-ffff-45d9-9011-b2a53749e6b1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:31.357482 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62304379-ffff-45d9-9011-b2a53749e6b1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:31.358709 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62304379-ffff-45d9-9011-b2a53749e6b1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:31.400838 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62304379-ffff-45d9-9011-b2a53749e6b1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:31.401287 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62304379-ffff-45d9-9011-b2a53749e6b1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:31.401876 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-62304379-ffff-45d9-9011-b2a53749e6b1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lazy-loading 'fault' on Instance uuid c0f418ad-1f7d-439b-9608-bce7843145bf {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:35:31.445317 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-96476403-397f-4ff0-8aa7-eea3225d18c7 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:31.446052 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-96476403-397f-4ff0-8aa7-eea3225d18c7 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:31.454590 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96476403-397f-4ff0-8aa7-eea3225d18c7 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:31.455092 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96476403-397f-4ff0-8aa7-eea3225d18c7 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:31.455888 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96476403-397f-4ff0-8aa7-eea3225d18c7 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:31.456322 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-96476403-397f-4ff0-8aa7-eea3225d18c7 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:31.479377 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-62304379-ffff-45d9-9011-b2a53749e6b1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:31.515747 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-62304379-ffff-45d9-9011-b2a53749e6b1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 200 len: 1308 microversion: 2.1 time: 0.179450 Feb 21 01:35:31.516357 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 222/460] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:31 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 1308 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:31.558223 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-96476403-397f-4ff0-8aa7-eea3225d18c7 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:31.575712 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-96476403-397f-4ff0-8aa7-eea3225d18c7 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1310 microversion: 2.1 time: 0.142276 Feb 21 01:35:31.576440 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 239/461] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:31 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1310 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:35:31.826730 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8829baf6-ea97-4e20-a41d-e2c93ec6729b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:31.827620 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8829baf6-ea97-4e20-a41d-e2c93ec6729b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:31.834946 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8829baf6-ea97-4e20-a41d-e2c93ec6729b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:31.835604 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8829baf6-ea97-4e20-a41d-e2c93ec6729b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:31.837773 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8829baf6-ea97-4e20-a41d-e2c93ec6729b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:31.837773 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8829baf6-ea97-4e20-a41d-e2c93ec6729b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:31.890184 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8829baf6-ea97-4e20-a41d-e2c93ec6729b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:31.902152 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8829baf6-ea97-4e20-a41d-e2c93ec6729b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:31.904552 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-8829baf6-ea97-4e20-a41d-e2c93ec6729b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lazy-loading 'fault' on Instance uuid 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:35:31.958754 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-8829baf6-ea97-4e20-a41d-e2c93ec6729b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:31.965235 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8829baf6-ea97-4e20-a41d-e2c93ec6729b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 200 len: 1312 microversion: 2.1 time: 0.142088 Feb 21 01:35:31.969228 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 223/462] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:31 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 1312 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:32.535889 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2f199629-9ed3-4903-8dfe-e0a39aabee7d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:32.537917 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2f199629-9ed3-4903-8dfe-e0a39aabee7d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: c0f418ad-1f7d-439b-9608-bce7843145bf] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:32.544025 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f199629-9ed3-4903-8dfe-e0a39aabee7d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:32.544827 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f199629-9ed3-4903-8dfe-e0a39aabee7d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:32.546596 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f199629-9ed3-4903-8dfe-e0a39aabee7d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:32.547278 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f199629-9ed3-4903-8dfe-e0a39aabee7d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:32.565431 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-2f199629-9ed3-4903-8dfe-e0a39aabee7d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] HTTP exception thrown: Instance c0f418ad-1f7d-439b-9608-bce7843145bf could not be found. Feb 21 01:35:32.566433 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2f199629-9ed3-4903-8dfe-e0a39aabee7d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Returning 404 to user: Instance c0f418ad-1f7d-439b-9608-bce7843145bf could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:35:32.567515 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2f199629-9ed3-4903-8dfe-e0a39aabee7d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf" status: 404 len: 111 microversion: 2.1 time: 0.036340 Feb 21 01:35:32.568710 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 240/463] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:32 2022] GET /compute/v2.1/servers/c0f418ad-1f7d-439b-9608-bce7843145bf => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:35:32.600372 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bfeafb96-67b5-47c0-8516-eca5d3a933c1 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:32.602183 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bfeafb96-67b5-47c0-8516-eca5d3a933c1 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:32.614893 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfeafb96-67b5-47c0-8516-eca5d3a933c1 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:32.619463 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfeafb96-67b5-47c0-8516-eca5d3a933c1 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:32.621899 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfeafb96-67b5-47c0-8516-eca5d3a933c1 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:32.622544 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bfeafb96-67b5-47c0-8516-eca5d3a933c1 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:32.711486 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-bfeafb96-67b5-47c0-8516-eca5d3a933c1 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:32.720918 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bfeafb96-67b5-47c0-8516-eca5d3a933c1 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1316 microversion: 2.1 time: 0.129819 Feb 21 01:35:32.721962 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 241/464] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:32 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1316 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:32.864941 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f1f397b1-97ce-482f-bfcd-788d92774c65 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Action: 'create', calling method: .version_select at 0x7f4075eb14c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1144935184"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:35:32.891492 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-f1f397b1-97ce-482f-bfcd-788d92774c65 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Getting quotas for project 360e1042eb3f47f5be6a603e1877d9d8. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:35:32.895845 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-f1f397b1-97ce-482f-bfcd-788d92774c65 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Getting quotas for user 07356563a079427b97e47ce2a11b54b7 and project 360e1042eb3f47f5be6a603e1877d9d8. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:35:32.909044 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f1f397b1-97ce-482f-bfcd-788d92774c65 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [3c809fc5-25f0-4007-8c09-863adffe9bdc] AMQP server on 10.222.0.90:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 21 01:35:32.982006 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1e1c012d-ce7a-48ff-928a-56ee3affdf3a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:32.982800 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1e1c012d-ce7a-48ff-928a-56ee3affdf3a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:32.988806 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e1c012d-ce7a-48ff-928a-56ee3affdf3a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:32.989285 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e1c012d-ce7a-48ff-928a-56ee3affdf3a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:32.990125 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e1c012d-ce7a-48ff-928a-56ee3affdf3a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:32.990626 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e1c012d-ce7a-48ff-928a-56ee3affdf3a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:33.005102 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-1e1c012d-ce7a-48ff-928a-56ee3affdf3a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] HTTP exception thrown: Instance 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 could not be found. Feb 21 01:35:33.005771 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1e1c012d-ce7a-48ff-928a-56ee3affdf3a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Returning 404 to user: Instance 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:35:33.007161 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1e1c012d-ce7a-48ff-928a-56ee3affdf3a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8" status: 404 len: 111 microversion: 2.1 time: 0.028917 Feb 21 01:35:33.007808 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 242/465] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:32 2022] GET /compute/v2.1/servers/34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 21 01:35:33.015793 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-488abdfb-fc45-41fd-a0e6-d591ce60f28c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:33.016284 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-488abdfb-fc45-41fd-a0e6-d591ce60f28c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:33.023580 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-488abdfb-fc45-41fd-a0e6-d591ce60f28c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:33.024028 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-488abdfb-fc45-41fd-a0e6-d591ce60f28c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:33.024847 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-488abdfb-fc45-41fd-a0e6-d591ce60f28c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:33.025283 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-488abdfb-fc45-41fd-a0e6-d591ce60f28c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:33.050043 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-488abdfb-fc45-41fd-a0e6-d591ce60f28c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:35:33.434701 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-488abdfb-fc45-41fd-a0e6-d591ce60f28c tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "DELETE /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 204 len: 0 microversion: 2.1 time: 0.422189 Feb 21 01:35:33.438661 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 243/466] 10.222.0.90 () {58 vars in 1238 bytes} [Mon Feb 21 01:35:33 2022] DELETE /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:35:33.440453 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-738cef55-7e24-48c1-8f0d-818c547e4837 req-7a8f3bf1-29a3-4f24-9a83-c8104b6e5a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8", "name": "network-vif-deleted", "tag": "4f6f4bf6-c2bb-4409-855b-387ebc13aa76"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:35:33.442148 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:35:33.442148 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:35:33.451585 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-738cef55-7e24-48c1-8f0d-818c547e4837 req-7a8f3bf1-29a3-4f24-9a83-c8104b6e5a48 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:33.452085 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-738cef55-7e24-48c1-8f0d-818c547e4837 req-7a8f3bf1-29a3-4f24-9a83-c8104b6e5a48 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:33.467350 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-738cef55-7e24-48c1-8f0d-818c547e4837 req-7a8f3bf1-29a3-4f24-9a83-c8104b6e5a48 service nova] Creating event network-vif-deleted:4f6f4bf6-c2bb-4409-855b-387ebc13aa76 for instance 34e0a8d3-f0c7-45f1-b41c-86fd0b3317e8 on hv-cinder-81322 Feb 21 01:35:33.473448 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-738cef55-7e24-48c1-8f0d-818c547e4837 req-7a8f3bf1-29a3-4f24-9a83-c8104b6e5a48 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036725 Feb 21 01:35:33.474106 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 244/467] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:35:33.485891 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-33959466-58a9-4d02-913b-7140337f22be tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:33.486725 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-33959466-58a9-4d02-913b-7140337f22be tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:33.494029 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33959466-58a9-4d02-913b-7140337f22be tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:33.494557 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33959466-58a9-4d02-913b-7140337f22be tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:33.495424 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33959466-58a9-4d02-913b-7140337f22be tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:33.495936 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-33959466-58a9-4d02-913b-7140337f22be tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:33.757954 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-33959466-58a9-4d02-913b-7140337f22be tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:33.768057 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-33959466-58a9-4d02-913b-7140337f22be tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.289939 Feb 21 01:35:33.772560 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 245/468] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:33 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:33.779778 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e59d205b-e26d-42f0-853d-d5d458598d3f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:33.780413 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e59d205b-e26d-42f0-853d-d5d458598d3f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:33.793851 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e59d205b-e26d-42f0-853d-d5d458598d3f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:33.796847 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e59d205b-e26d-42f0-853d-d5d458598d3f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:33.797836 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e59d205b-e26d-42f0-853d-d5d458598d3f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:33.799338 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e59d205b-e26d-42f0-853d-d5d458598d3f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:33.916004 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [None req-f1f397b1-97ce-482f-bfcd-788d92774c65 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [3c809fc5-25f0-4007-8c09-863adffe9bdc] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 55052. Feb 21 01:35:33.961889 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-e59d205b-e26d-42f0-853d-d5d458598d3f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:33.970436 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e59d205b-e26d-42f0-853d-d5d458598d3f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1358 microversion: 2.1 time: 0.199979 Feb 21 01:35:33.983140 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 246/469] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:33 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:33.991644 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2a451067-3c04-451b-b4d7-f9c0ed136dbb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:33.992220 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2a451067-3c04-451b-b4d7-f9c0ed136dbb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:34.007330 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a451067-3c04-451b-b4d7-f9c0ed136dbb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:34.007780 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a451067-3c04-451b-b4d7-f9c0ed136dbb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:34.008875 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a451067-3c04-451b-b4d7-f9c0ed136dbb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:34.009312 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a451067-3c04-451b-b4d7-f9c0ed136dbb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:34.061789 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2a451067-3c04-451b-b4d7-f9c0ed136dbb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:35:34.177119 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-f1f397b1-97ce-482f-bfcd-788d92774c65 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Getting quotas for project 360e1042eb3f47f5be6a603e1877d9d8. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:35:34.181681 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-f1f397b1-97ce-482f-bfcd-788d92774c65 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Getting quotas for user 07356563a079427b97e47ce2a11b54b7 and project 360e1042eb3f47f5be6a603e1877d9d8. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:35:34.195198 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f1f397b1-97ce-482f-bfcd-788d92774c65 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 1.629486 Feb 21 01:35:34.196103 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 224/470] 10.222.0.90 () {60 vars in 1157 bytes} [Mon Feb 21 01:35:32 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:34.424090 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2a451067-3c04-451b-b4d7-f9c0ed136dbb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "DELETE /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 204 len: 0 microversion: 2.1 time: 0.436578 Feb 21 01:35:34.424980 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 247/471] 10.222.0.90 () {58 vars in 1238 bytes} [Mon Feb 21 01:35:33 2022] DELETE /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:35:34.432910 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6ca9430d-cca3-47fd-9486-24b33d6b9da4 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:34.433809 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6ca9430d-cca3-47fd-9486-24b33d6b9da4 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:34.440138 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ca9430d-cca3-47fd-9486-24b33d6b9da4 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:34.440619 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ca9430d-cca3-47fd-9486-24b33d6b9da4 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:34.441405 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ca9430d-cca3-47fd-9486-24b33d6b9da4 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:34.441833 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ca9430d-cca3-47fd-9486-24b33d6b9da4 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:34.599376 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-6ca9430d-cca3-47fd-9486-24b33d6b9da4 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:34.612086 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6ca9430d-cca3-47fd-9486-24b33d6b9da4 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1512 microversion: 2.1 time: 0.182635 Feb 21 01:35:34.617967 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 225/472] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:34 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1512 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:34.788889 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ff96497f-cd10-41dd-8f75-b65e8aa39cb3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:34.789661 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ff96497f-cd10-41dd-8f75-b65e8aa39cb3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:34.795762 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff96497f-cd10-41dd-8f75-b65e8aa39cb3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:34.796216 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff96497f-cd10-41dd-8f75-b65e8aa39cb3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:34.797047 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff96497f-cd10-41dd-8f75-b65e8aa39cb3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:34.797476 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff96497f-cd10-41dd-8f75-b65e8aa39cb3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:34.973028 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-ff96497f-cd10-41dd-8f75-b65e8aa39cb3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:34.981360 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ff96497f-cd10-41dd-8f75-b65e8aa39cb3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.199580 Feb 21 01:35:34.992100 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 248/473] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:34 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:35.000227 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d33c8978-f2f3-45f5-a9f1-bc1585945fdf tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:35.004604 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d33c8978-f2f3-45f5-a9f1-bc1585945fdf tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:35.008858 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d33c8978-f2f3-45f5-a9f1-bc1585945fdf tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:35.009389 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d33c8978-f2f3-45f5-a9f1-bc1585945fdf tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:35.011039 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d33c8978-f2f3-45f5-a9f1-bc1585945fdf tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:35.012046 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d33c8978-f2f3-45f5-a9f1-bc1585945fdf tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:35.179676 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-d33c8978-f2f3-45f5-a9f1-bc1585945fdf tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:35.189351 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d33c8978-f2f3-45f5-a9f1-bc1585945fdf tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1358 microversion: 2.1 time: 0.199232 Feb 21 01:35:35.189959 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 226/474] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:34 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:35.634979 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-420191f0-d4c8-4548-bb9e-d0d8bb0745e3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:35.635751 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-420191f0-d4c8-4548-bb9e-d0d8bb0745e3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:35.642110 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-420191f0-d4c8-4548-bb9e-d0d8bb0745e3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:35.642638 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-420191f0-d4c8-4548-bb9e-d0d8bb0745e3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:35.643649 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-420191f0-d4c8-4548-bb9e-d0d8bb0745e3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:35.644145 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-420191f0-d4c8-4548-bb9e-d0d8bb0745e3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:35.816558 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-420191f0-d4c8-4548-bb9e-d0d8bb0745e3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:35.825867 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-420191f0-d4c8-4548-bb9e-d0d8bb0745e3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1512 microversion: 2.1 time: 0.195158 Feb 21 01:35:35.827716 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 249/475] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:35 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1512 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:35.998914 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cf1e4303-8c97-4088-9ffe-1c3703fca329 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:35.999537 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cf1e4303-8c97-4088-9ffe-1c3703fca329 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:36.012948 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf1e4303-8c97-4088-9ffe-1c3703fca329 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:36.013530 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf1e4303-8c97-4088-9ffe-1c3703fca329 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:36.014585 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf1e4303-8c97-4088-9ffe-1c3703fca329 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:36.015182 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cf1e4303-8c97-4088-9ffe-1c3703fca329 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:36.199013 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-cf1e4303-8c97-4088-9ffe-1c3703fca329 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:36.206757 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0be4693b-c7ee-4bfa-91a2-8122abe12f0e tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:36.207623 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0be4693b-c7ee-4bfa-91a2-8122abe12f0e tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:36.210938 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cf1e4303-8c97-4088-9ffe-1c3703fca329 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.215596 Feb 21 01:35:36.221184 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 227/476] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:35 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:36.224949 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0be4693b-c7ee-4bfa-91a2-8122abe12f0e tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:36.226212 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0be4693b-c7ee-4bfa-91a2-8122abe12f0e tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:36.227065 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0be4693b-c7ee-4bfa-91a2-8122abe12f0e tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:36.227486 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0be4693b-c7ee-4bfa-91a2-8122abe12f0e tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:36.430016 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-0be4693b-c7ee-4bfa-91a2-8122abe12f0e tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:36.438077 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0be4693b-c7ee-4bfa-91a2-8122abe12f0e tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1358 microversion: 2.1 time: 0.235722 Feb 21 01:35:36.448248 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 250/477] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:36 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:35:36.844086 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-77a1975d-78cf-435e-9ad4-a112054ca285 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:36.845107 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-77a1975d-78cf-435e-9ad4-a112054ca285 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:36.859884 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77a1975d-78cf-435e-9ad4-a112054ca285 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:36.860402 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77a1975d-78cf-435e-9ad4-a112054ca285 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:36.863369 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77a1975d-78cf-435e-9ad4-a112054ca285 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:36.865702 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77a1975d-78cf-435e-9ad4-a112054ca285 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:37.116774 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-77a1975d-78cf-435e-9ad4-a112054ca285 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:37.126139 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-77a1975d-78cf-435e-9ad4-a112054ca285 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1512 microversion: 2.1 time: 0.285700 Feb 21 01:35:37.138372 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 228/478] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:36 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1512 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:37.227653 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d8cd71bc-fa48-43a1-a874-0cb0dc0481b5 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:37.228537 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d8cd71bc-fa48-43a1-a874-0cb0dc0481b5 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:37.239363 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8cd71bc-fa48-43a1-a874-0cb0dc0481b5 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:37.240057 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8cd71bc-fa48-43a1-a874-0cb0dc0481b5 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:37.240897 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8cd71bc-fa48-43a1-a874-0cb0dc0481b5 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:37.241401 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8cd71bc-fa48-43a1-a874-0cb0dc0481b5 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:37.397806 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-d8cd71bc-fa48-43a1-a874-0cb0dc0481b5 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:37.406031 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d8cd71bc-fa48-43a1-a874-0cb0dc0481b5 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.182752 Feb 21 01:35:37.407070 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 251/479] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:37 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:37.454913 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0dcb577c-75e6-48a1-8c09-228dc5e2596f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:37.455544 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0dcb577c-75e6-48a1-8c09-228dc5e2596f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:37.462061 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0dcb577c-75e6-48a1-8c09-228dc5e2596f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:37.462495 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0dcb577c-75e6-48a1-8c09-228dc5e2596f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:37.463252 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0dcb577c-75e6-48a1-8c09-228dc5e2596f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:37.463674 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0dcb577c-75e6-48a1-8c09-228dc5e2596f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:37.717772 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-0dcb577c-75e6-48a1-8c09-228dc5e2596f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:37.725416 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0dcb577c-75e6-48a1-8c09-228dc5e2596f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1358 microversion: 2.1 time: 0.274108 Feb 21 01:35:37.728470 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 229/480] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:37 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1358 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:38.145122 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-41c40cd7-b481-4b05-8de6-63764125d5a9 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:38.145799 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-41c40cd7-b481-4b05-8de6-63764125d5a9 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:38.157041 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41c40cd7-b481-4b05-8de6-63764125d5a9 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:38.157485 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41c40cd7-b481-4b05-8de6-63764125d5a9 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:38.158270 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41c40cd7-b481-4b05-8de6-63764125d5a9 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:38.158701 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41c40cd7-b481-4b05-8de6-63764125d5a9 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:38.314343 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-41c40cd7-b481-4b05-8de6-63764125d5a9 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:38.321678 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-41c40cd7-b481-4b05-8de6-63764125d5a9 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1512 microversion: 2.1 time: 0.180499 Feb 21 01:35:38.322235 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 252/481] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:38 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1512 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:38.422901 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-74a3268b-52e6-40bf-8a10-9011ca379bf9 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:38.423528 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-74a3268b-52e6-40bf-8a10-9011ca379bf9 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:38.431404 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74a3268b-52e6-40bf-8a10-9011ca379bf9 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:38.431857 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74a3268b-52e6-40bf-8a10-9011ca379bf9 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:38.432723 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74a3268b-52e6-40bf-8a10-9011ca379bf9 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:38.433158 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-74a3268b-52e6-40bf-8a10-9011ca379bf9 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:38.589750 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-74a3268b-52e6-40bf-8a10-9011ca379bf9 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:38.605546 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-74a3268b-52e6-40bf-8a10-9011ca379bf9 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.186258 Feb 21 01:35:38.606472 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 230/482] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:38 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:38.742720 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-17c56f87-fb3f-493d-bd1c-938f05d7da50 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:38.743331 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-17c56f87-fb3f-493d-bd1c-938f05d7da50 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:38.749299 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-17c56f87-fb3f-493d-bd1c-938f05d7da50 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:38.749750 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-17c56f87-fb3f-493d-bd1c-938f05d7da50 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:38.750537 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-17c56f87-fb3f-493d-bd1c-938f05d7da50 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:38.750972 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-17c56f87-fb3f-493d-bd1c-938f05d7da50 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:38.916745 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-17c56f87-fb3f-493d-bd1c-938f05d7da50 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:38.926968 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-17c56f87-fb3f-493d-bd1c-938f05d7da50 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1358 microversion: 2.1 time: 0.185223 Feb 21 01:35:38.926968 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 253/483] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:38 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:39.339023 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6c3626db-ac47-4314-b4b9-fa8c90ee8cef tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:39.339629 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6c3626db-ac47-4314-b4b9-fa8c90ee8cef tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:39.345694 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c3626db-ac47-4314-b4b9-fa8c90ee8cef tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:39.346332 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c3626db-ac47-4314-b4b9-fa8c90ee8cef tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:39.347628 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c3626db-ac47-4314-b4b9-fa8c90ee8cef tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:39.348657 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c3626db-ac47-4314-b4b9-fa8c90ee8cef tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:39.491740 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-6c3626db-ac47-4314-b4b9-fa8c90ee8cef tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:39.498981 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6c3626db-ac47-4314-b4b9-fa8c90ee8cef tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1512 microversion: 2.1 time: 0.163629 Feb 21 01:35:39.499566 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 231/484] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:39 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:39.624260 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-13378d8b-a2fe-4fca-8ebf-67688a916c97 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:39.625014 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-13378d8b-a2fe-4fca-8ebf-67688a916c97 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:39.631908 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13378d8b-a2fe-4fca-8ebf-67688a916c97 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:39.632584 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13378d8b-a2fe-4fca-8ebf-67688a916c97 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:39.633494 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13378d8b-a2fe-4fca-8ebf-67688a916c97 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:39.634181 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-13378d8b-a2fe-4fca-8ebf-67688a916c97 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:39.782261 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-13378d8b-a2fe-4fca-8ebf-67688a916c97 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:39.790301 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-13378d8b-a2fe-4fca-8ebf-67688a916c97 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.170491 Feb 21 01:35:39.790898 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 254/485] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:39 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:39.940938 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-78143af2-02e3-4cea-94a3-ca93c22c65fe tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:39.941541 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-78143af2-02e3-4cea-94a3-ca93c22c65fe tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:39.947462 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78143af2-02e3-4cea-94a3-ca93c22c65fe tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:39.947905 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78143af2-02e3-4cea-94a3-ca93c22c65fe tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:39.949313 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78143af2-02e3-4cea-94a3-ca93c22c65fe tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:39.949751 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-78143af2-02e3-4cea-94a3-ca93c22c65fe tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:40.095790 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-78143af2-02e3-4cea-94a3-ca93c22c65fe tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:40.103521 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-78143af2-02e3-4cea-94a3-ca93c22c65fe tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1358 microversion: 2.1 time: 0.166299 Feb 21 01:35:40.104163 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 232/486] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:39 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:40.521058 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6a268809-4797-4927-b84d-324eca02b9a1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:40.522557 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6a268809-4797-4927-b84d-324eca02b9a1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:40.528675 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a268809-4797-4927-b84d-324eca02b9a1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:40.529156 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a268809-4797-4927-b84d-324eca02b9a1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:40.535634 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a268809-4797-4927-b84d-324eca02b9a1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:40.535634 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a268809-4797-4927-b84d-324eca02b9a1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:40.670810 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-6a268809-4797-4927-b84d-324eca02b9a1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:40.678989 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6a268809-4797-4927-b84d-324eca02b9a1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1512 microversion: 2.1 time: 0.165498 Feb 21 01:35:40.679557 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 255/487] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:40 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:35:40.807643 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-85e66250-62d8-460b-aa4d-dafa5c82d1d4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:40.809237 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-85e66250-62d8-460b-aa4d-dafa5c82d1d4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:40.815906 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85e66250-62d8-460b-aa4d-dafa5c82d1d4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:40.816349 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85e66250-62d8-460b-aa4d-dafa5c82d1d4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:40.817169 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85e66250-62d8-460b-aa4d-dafa5c82d1d4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:40.817600 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85e66250-62d8-460b-aa4d-dafa5c82d1d4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:40.967790 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-85e66250-62d8-460b-aa4d-dafa5c82d1d4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:40.975146 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-85e66250-62d8-460b-aa4d-dafa5c82d1d4 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.171327 Feb 21 01:35:40.975711 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 233/488] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:40 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:41.121252 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3d10adc7-56ab-4033-821c-b3933b7f4fe2 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:41.121877 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3d10adc7-56ab-4033-821c-b3933b7f4fe2 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:41.127815 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d10adc7-56ab-4033-821c-b3933b7f4fe2 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:41.128224 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d10adc7-56ab-4033-821c-b3933b7f4fe2 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:41.129039 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d10adc7-56ab-4033-821c-b3933b7f4fe2 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:41.129465 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3d10adc7-56ab-4033-821c-b3933b7f4fe2 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:41.282050 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-3d10adc7-56ab-4033-821c-b3933b7f4fe2 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:41.291758 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3d10adc7-56ab-4033-821c-b3933b7f4fe2 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1358 microversion: 2.1 time: 0.174114 Feb 21 01:35:41.292472 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 256/489] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:41 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:35:41.695670 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3763ed2c-d8ab-4c58-a005-6413bcdef4a7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:41.696215 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3763ed2c-d8ab-4c58-a005-6413bcdef4a7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:41.702130 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3763ed2c-d8ab-4c58-a005-6413bcdef4a7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:41.702586 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3763ed2c-d8ab-4c58-a005-6413bcdef4a7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:41.703363 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3763ed2c-d8ab-4c58-a005-6413bcdef4a7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:41.703968 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3763ed2c-d8ab-4c58-a005-6413bcdef4a7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:41.851115 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-3763ed2c-d8ab-4c58-a005-6413bcdef4a7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:41.859272 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3763ed2c-d8ab-4c58-a005-6413bcdef4a7 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1512 microversion: 2.1 time: 0.167858 Feb 21 01:35:41.859836 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 234/490] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:41 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:41.992061 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-19f223fc-9e94-49c1-8bc0-8aaf04cf8cf7 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:41.992686 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-19f223fc-9e94-49c1-8bc0-8aaf04cf8cf7 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:41.999108 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19f223fc-9e94-49c1-8bc0-8aaf04cf8cf7 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:41.999557 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19f223fc-9e94-49c1-8bc0-8aaf04cf8cf7 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:42.000366 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19f223fc-9e94-49c1-8bc0-8aaf04cf8cf7 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:42.000823 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-19f223fc-9e94-49c1-8bc0-8aaf04cf8cf7 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:42.147739 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-19f223fc-9e94-49c1-8bc0-8aaf04cf8cf7 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:42.154945 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-19f223fc-9e94-49c1-8bc0-8aaf04cf8cf7 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.166580 Feb 21 01:35:42.155503 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 257/491] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:41 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:42.309392 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3d39aef5-a396-4e62-896c-18e086dcd3b9 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:42.309999 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3d39aef5-a396-4e62-896c-18e086dcd3b9 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:42.316015 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d39aef5-a396-4e62-896c-18e086dcd3b9 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:42.316383 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d39aef5-a396-4e62-896c-18e086dcd3b9 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:42.317188 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d39aef5-a396-4e62-896c-18e086dcd3b9 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:42.317612 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3d39aef5-a396-4e62-896c-18e086dcd3b9 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:42.455980 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-3d39aef5-a396-4e62-896c-18e086dcd3b9 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:42.464001 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3d39aef5-a396-4e62-896c-18e086dcd3b9 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1358 microversion: 2.1 time: 0.158145 Feb 21 01:35:42.464601 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 235/492] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:42 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:42.875950 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f3157f25-e093-4bb4-a895-2bf80b3c47b3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:42.876789 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f3157f25-e093-4bb4-a895-2bf80b3c47b3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:42.883156 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3157f25-e093-4bb4-a895-2bf80b3c47b3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:42.883964 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3157f25-e093-4bb4-a895-2bf80b3c47b3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:42.884856 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3157f25-e093-4bb4-a895-2bf80b3c47b3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:42.885361 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3157f25-e093-4bb4-a895-2bf80b3c47b3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:43.025774 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-f3157f25-e093-4bb4-a895-2bf80b3c47b3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:43.033500 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f3157f25-e093-4bb4-a895-2bf80b3c47b3 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1512 microversion: 2.1 time: 0.161366 Feb 21 01:35:43.034390 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 258/493] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:42 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:43.171357 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-09393165-6f7f-4f8c-b360-856f35e1d4f7 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:43.171992 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-09393165-6f7f-4f8c-b360-856f35e1d4f7 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:43.178264 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09393165-6f7f-4f8c-b360-856f35e1d4f7 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:43.178726 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09393165-6f7f-4f8c-b360-856f35e1d4f7 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:43.179466 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09393165-6f7f-4f8c-b360-856f35e1d4f7 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:43.179921 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09393165-6f7f-4f8c-b360-856f35e1d4f7 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:43.313926 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-09393165-6f7f-4f8c-b360-856f35e1d4f7 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:43.321771 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-09393165-6f7f-4f8c-b360-856f35e1d4f7 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.154351 Feb 21 01:35:43.332706 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 236/494] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:43 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:43.480389 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-50c51d86-4740-4541-a1ac-db9561fad5e7 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:43.480931 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-50c51d86-4740-4541-a1ac-db9561fad5e7 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:43.486710 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50c51d86-4740-4541-a1ac-db9561fad5e7 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:43.487150 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50c51d86-4740-4541-a1ac-db9561fad5e7 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:43.487903 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50c51d86-4740-4541-a1ac-db9561fad5e7 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:43.488328 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-50c51d86-4740-4541-a1ac-db9561fad5e7 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:43.635961 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-50c51d86-4740-4541-a1ac-db9561fad5e7 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:43.643961 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-50c51d86-4740-4541-a1ac-db9561fad5e7 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1358 microversion: 2.1 time: 0.167172 Feb 21 01:35:43.644673 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 259/495] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:43 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:44.051331 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8711a5fe-a4f5-443f-ad2b-7a24f4a19610 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:44.052200 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8711a5fe-a4f5-443f-ad2b-7a24f4a19610 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:44.059267 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8711a5fe-a4f5-443f-ad2b-7a24f4a19610 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:44.059720 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8711a5fe-a4f5-443f-ad2b-7a24f4a19610 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:44.060536 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8711a5fe-a4f5-443f-ad2b-7a24f4a19610 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:44.060972 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8711a5fe-a4f5-443f-ad2b-7a24f4a19610 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:44.201155 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-8711a5fe-a4f5-443f-ad2b-7a24f4a19610 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:44.206245 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8711a5fe-a4f5-443f-ad2b-7a24f4a19610 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1512 microversion: 2.1 time: 0.158572 Feb 21 01:35:44.207073 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 237/496] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:44 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:44.340387 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-87bc9a9d-52ca-4f5d-a1c0-0526b747a76b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:44.340979 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-87bc9a9d-52ca-4f5d-a1c0-0526b747a76b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:44.347365 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87bc9a9d-52ca-4f5d-a1c0-0526b747a76b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:44.347820 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87bc9a9d-52ca-4f5d-a1c0-0526b747a76b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:44.348637 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87bc9a9d-52ca-4f5d-a1c0-0526b747a76b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:44.349070 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87bc9a9d-52ca-4f5d-a1c0-0526b747a76b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:44.493373 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-87bc9a9d-52ca-4f5d-a1c0-0526b747a76b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:44.500798 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-87bc9a9d-52ca-4f5d-a1c0-0526b747a76b tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.164788 Feb 21 01:35:44.504543 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 260/497] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:44 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:44.663233 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9194cb99-164f-4334-a5e6-7a081b4ecc8f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:44.663843 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9194cb99-164f-4334-a5e6-7a081b4ecc8f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:44.670022 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9194cb99-164f-4334-a5e6-7a081b4ecc8f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:44.670694 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9194cb99-164f-4334-a5e6-7a081b4ecc8f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:44.672457 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9194cb99-164f-4334-a5e6-7a081b4ecc8f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:44.672457 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9194cb99-164f-4334-a5e6-7a081b4ecc8f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:44.829848 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-9194cb99-164f-4334-a5e6-7a081b4ecc8f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:44.837514 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9194cb99-164f-4334-a5e6-7a081b4ecc8f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1358 microversion: 2.1 time: 0.179351 Feb 21 01:35:44.838076 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 238/498] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:44 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:45.223200 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e6db6536-9901-42fd-97bb-d144f52ed8be tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:45.223809 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e6db6536-9901-42fd-97bb-d144f52ed8be tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:45.235798 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6db6536-9901-42fd-97bb-d144f52ed8be tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:45.236255 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6db6536-9901-42fd-97bb-d144f52ed8be tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:45.237528 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6db6536-9901-42fd-97bb-d144f52ed8be tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:45.237975 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6db6536-9901-42fd-97bb-d144f52ed8be tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:45.373094 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-e6db6536-9901-42fd-97bb-d144f52ed8be tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:45.381076 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e6db6536-9901-42fd-97bb-d144f52ed8be tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1512 microversion: 2.1 time: 0.160889 Feb 21 01:35:45.381689 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 261/499] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:45 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:45.517822 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-abe3e29f-5feb-4c65-94e2-6b549218ef16 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:45.518439 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-abe3e29f-5feb-4c65-94e2-6b549218ef16 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:45.524685 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abe3e29f-5feb-4c65-94e2-6b549218ef16 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:45.525138 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abe3e29f-5feb-4c65-94e2-6b549218ef16 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:45.525942 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abe3e29f-5feb-4c65-94e2-6b549218ef16 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:45.526346 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-abe3e29f-5feb-4c65-94e2-6b549218ef16 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:45.667620 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-abe3e29f-5feb-4c65-94e2-6b549218ef16 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:45.675054 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-abe3e29f-5feb-4c65-94e2-6b549218ef16 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.160850 Feb 21 01:35:45.675631 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 239/500] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:45 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:45.854553 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bac5b2dd-9bc9-4d8a-87ed-1272711b2329 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:45.855163 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bac5b2dd-9bc9-4d8a-87ed-1272711b2329 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:45.860995 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bac5b2dd-9bc9-4d8a-87ed-1272711b2329 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:45.861444 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bac5b2dd-9bc9-4d8a-87ed-1272711b2329 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:45.862211 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bac5b2dd-9bc9-4d8a-87ed-1272711b2329 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:45.862645 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bac5b2dd-9bc9-4d8a-87ed-1272711b2329 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:45.997017 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-bac5b2dd-9bc9-4d8a-87ed-1272711b2329 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:46.004126 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bac5b2dd-9bc9-4d8a-87ed-1272711b2329 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1358 microversion: 2.1 time: 0.153226 Feb 21 01:35:46.004748 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 262/501] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:45 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:46.398173 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ee087eed-85d9-48bb-805b-89604ec60cda tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:46.398816 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ee087eed-85d9-48bb-805b-89604ec60cda tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:46.404725 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee087eed-85d9-48bb-805b-89604ec60cda tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:46.405172 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee087eed-85d9-48bb-805b-89604ec60cda tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:46.405939 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee087eed-85d9-48bb-805b-89604ec60cda tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:46.406372 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee087eed-85d9-48bb-805b-89604ec60cda tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:46.540001 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ee087eed-85d9-48bb-805b-89604ec60cda tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:46.547366 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ee087eed-85d9-48bb-805b-89604ec60cda tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1512 microversion: 2.1 time: 0.152840 Feb 21 01:35:46.547930 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 240/502] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:46 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:46.690876 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-270660e4-9f3d-476b-aa9e-8394517e3fde tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:46.691506 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-270660e4-9f3d-476b-aa9e-8394517e3fde tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:46.697866 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-270660e4-9f3d-476b-aa9e-8394517e3fde tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:46.698309 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-270660e4-9f3d-476b-aa9e-8394517e3fde tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:46.699076 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-270660e4-9f3d-476b-aa9e-8394517e3fde tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:46.699506 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-270660e4-9f3d-476b-aa9e-8394517e3fde tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:46.830756 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-270660e4-9f3d-476b-aa9e-8394517e3fde tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:46.838481 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-270660e4-9f3d-476b-aa9e-8394517e3fde tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.151238 Feb 21 01:35:46.839054 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 263/503] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:46 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:47.022010 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e90567e6-52a0-46a5-8985-e42f8e0dde41 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:47.022654 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e90567e6-52a0-46a5-8985-e42f8e0dde41 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:47.028667 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e90567e6-52a0-46a5-8985-e42f8e0dde41 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:47.029111 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e90567e6-52a0-46a5-8985-e42f8e0dde41 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:47.029881 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e90567e6-52a0-46a5-8985-e42f8e0dde41 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:47.030307 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e90567e6-52a0-46a5-8985-e42f8e0dde41 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:47.160393 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-e90567e6-52a0-46a5-8985-e42f8e0dde41 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:47.168054 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e90567e6-52a0-46a5-8985-e42f8e0dde41 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1358 microversion: 2.1 time: 0.150050 Feb 21 01:35:47.168647 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 241/504] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:47 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:47.563893 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4d7310bc-442f-42b5-99a5-591cdeb7d4d8 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:47.564521 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4d7310bc-442f-42b5-99a5-591cdeb7d4d8 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:47.570445 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4d7310bc-442f-42b5-99a5-591cdeb7d4d8 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:47.570889 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4d7310bc-442f-42b5-99a5-591cdeb7d4d8 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:47.571655 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4d7310bc-442f-42b5-99a5-591cdeb7d4d8 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:47.572094 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4d7310bc-442f-42b5-99a5-591cdeb7d4d8 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:47.718355 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-4d7310bc-442f-42b5-99a5-591cdeb7d4d8 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:47.726134 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4d7310bc-442f-42b5-99a5-591cdeb7d4d8 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1512 microversion: 2.1 time: 0.165980 Feb 21 01:35:47.726692 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 264/505] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:47 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:47.855447 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5c8f1575-12b9-4e74-a36c-0a44f56802b3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:47.856101 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5c8f1575-12b9-4e74-a36c-0a44f56802b3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:47.862391 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c8f1575-12b9-4e74-a36c-0a44f56802b3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:47.862843 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c8f1575-12b9-4e74-a36c-0a44f56802b3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:47.863615 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c8f1575-12b9-4e74-a36c-0a44f56802b3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:47.864048 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5c8f1575-12b9-4e74-a36c-0a44f56802b3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:47.993638 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-5c8f1575-12b9-4e74-a36c-0a44f56802b3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:48.000735 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5c8f1575-12b9-4e74-a36c-0a44f56802b3 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.148932 Feb 21 01:35:48.001298 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 242/506] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:47 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:48.184856 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b128f3af-0803-4393-9d4e-ae6ff444b6b8 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:48.185390 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b128f3af-0803-4393-9d4e-ae6ff444b6b8 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:48.191322 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b128f3af-0803-4393-9d4e-ae6ff444b6b8 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:48.191772 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b128f3af-0803-4393-9d4e-ae6ff444b6b8 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:48.192580 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b128f3af-0803-4393-9d4e-ae6ff444b6b8 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:48.193926 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b128f3af-0803-4393-9d4e-ae6ff444b6b8 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:48.332407 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b128f3af-0803-4393-9d4e-ae6ff444b6b8 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:48.339867 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b128f3af-0803-4393-9d4e-ae6ff444b6b8 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1358 microversion: 2.1 time: 0.159044 Feb 21 01:35:48.340434 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 265/507] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:48 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:48.743447 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0b7c28d5-9d53-4310-aaee-412e3cda8c82 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:48.744085 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0b7c28d5-9d53-4310-aaee-412e3cda8c82 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:48.749936 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b7c28d5-9d53-4310-aaee-412e3cda8c82 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:48.750388 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b7c28d5-9d53-4310-aaee-412e3cda8c82 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:48.751160 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b7c28d5-9d53-4310-aaee-412e3cda8c82 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:48.751718 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0b7c28d5-9d53-4310-aaee-412e3cda8c82 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:48.915065 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-0b7c28d5-9d53-4310-aaee-412e3cda8c82 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:48.922518 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0b7c28d5-9d53-4310-aaee-412e3cda8c82 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1512 microversion: 2.1 time: 0.183437 Feb 21 01:35:48.925568 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 243/508] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:48 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1512 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:49.017690 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b37cedb8-bf4b-49c3-bcb3-826fa810eb67 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:49.018290 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b37cedb8-bf4b-49c3-bcb3-826fa810eb67 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:49.024447 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b37cedb8-bf4b-49c3-bcb3-826fa810eb67 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:49.024924 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b37cedb8-bf4b-49c3-bcb3-826fa810eb67 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:49.025720 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b37cedb8-bf4b-49c3-bcb3-826fa810eb67 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:49.026243 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b37cedb8-bf4b-49c3-bcb3-826fa810eb67 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:49.247812 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b37cedb8-bf4b-49c3-bcb3-826fa810eb67 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:49.255167 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b37cedb8-bf4b-49c3-bcb3-826fa810eb67 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.241288 Feb 21 01:35:49.255938 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 266/509] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:49 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:49.356729 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c85e3f37-fb8f-48fb-bfc4-a9598e606970 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:49.357379 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c85e3f37-fb8f-48fb-bfc4-a9598e606970 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:49.363611 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c85e3f37-fb8f-48fb-bfc4-a9598e606970 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:49.364062 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c85e3f37-fb8f-48fb-bfc4-a9598e606970 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:49.364884 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c85e3f37-fb8f-48fb-bfc4-a9598e606970 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:49.365322 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c85e3f37-fb8f-48fb-bfc4-a9598e606970 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:49.790204 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c85e3f37-fb8f-48fb-bfc4-a9598e606970 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:49.797418 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c85e3f37-fb8f-48fb-bfc4-a9598e606970 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1358 microversion: 2.1 time: 0.444312 Feb 21 01:35:49.798000 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 244/510] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:49 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1358 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:49.911713 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-c91fecb5-8684-4a20-97f6-2fcc6691fb92 req-ce016cdb-4e26-4e3d-9343-877dce3d3a61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b613c437-8337-4ce8-82d9-843cd6ccbc04", "tag": "3c272f96-f321-4ccf-a91e-d7d0afd792b2"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:35:49.913960 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:35:49.913960 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:35:49.923898 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c91fecb5-8684-4a20-97f6-2fcc6691fb92 req-ce016cdb-4e26-4e3d-9343-877dce3d3a61 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:49.924446 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c91fecb5-8684-4a20-97f6-2fcc6691fb92 req-ce016cdb-4e26-4e3d-9343-877dce3d3a61 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:49.940293 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-09e03961-c1ff-48f6-9e47-5fbc817c885d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:49.941842 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-c91fecb5-8684-4a20-97f6-2fcc6691fb92 req-ce016cdb-4e26-4e3d-9343-877dce3d3a61 service nova] Creating event network-changed:3c272f96-f321-4ccf-a91e-d7d0afd792b2 for instance b613c437-8337-4ce8-82d9-843cd6ccbc04 on hv-cinder-81322 Feb 21 01:35:49.942263 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-09e03961-c1ff-48f6-9e47-5fbc817c885d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:49.948249 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-c91fecb5-8684-4a20-97f6-2fcc6691fb92 req-ce016cdb-4e26-4e3d-9343-877dce3d3a61 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045291 Feb 21 01:35:49.948891 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 267/511] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:35:49.951577 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09e03961-c1ff-48f6-9e47-5fbc817c885d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:49.951577 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09e03961-c1ff-48f6-9e47-5fbc817c885d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:49.954269 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09e03961-c1ff-48f6-9e47-5fbc817c885d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:49.954710 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-09e03961-c1ff-48f6-9e47-5fbc817c885d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:50.149280 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-09e03961-c1ff-48f6-9e47-5fbc817c885d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:50.158130 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-09e03961-c1ff-48f6-9e47-5fbc817c885d tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1512 microversion: 2.1 time: 0.221449 Feb 21 01:35:50.158642 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 245/512] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:49 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1512 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:35:50.272408 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-973e0e72-89b2-4f51-a135-77a972b72e4a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:50.273230 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-973e0e72-89b2-4f51-a135-77a972b72e4a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:50.279430 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-973e0e72-89b2-4f51-a135-77a972b72e4a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:50.280217 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-973e0e72-89b2-4f51-a135-77a972b72e4a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:50.281107 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-973e0e72-89b2-4f51-a135-77a972b72e4a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:50.281608 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-973e0e72-89b2-4f51-a135-77a972b72e4a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:50.493386 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-973e0e72-89b2-4f51-a135-77a972b72e4a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:50.501189 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-973e0e72-89b2-4f51-a135-77a972b72e4a tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.232618 Feb 21 01:35:50.503797 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 268/513] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:50 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:50.814657 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2c82c6b5-35d2-40e1-af57-6898c7d11600 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:50.815270 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2c82c6b5-35d2-40e1-af57-6898c7d11600 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:50.821263 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c82c6b5-35d2-40e1-af57-6898c7d11600 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:50.821743 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c82c6b5-35d2-40e1-af57-6898c7d11600 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:50.822517 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c82c6b5-35d2-40e1-af57-6898c7d11600 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:50.822952 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c82c6b5-35d2-40e1-af57-6898c7d11600 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:50.963179 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-2c82c6b5-35d2-40e1-af57-6898c7d11600 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:50.970447 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2c82c6b5-35d2-40e1-af57-6898c7d11600 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1358 microversion: 2.1 time: 0.159465 Feb 21 01:35:50.971008 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 246/514] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:50 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:51.176050 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6d52c52c-7fff-47a6-8e1b-e1f6a7501cf1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:51.176683 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6d52c52c-7fff-47a6-8e1b-e1f6a7501cf1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:51.182772 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d52c52c-7fff-47a6-8e1b-e1f6a7501cf1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:51.183216 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d52c52c-7fff-47a6-8e1b-e1f6a7501cf1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:51.183975 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d52c52c-7fff-47a6-8e1b-e1f6a7501cf1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:51.184405 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d52c52c-7fff-47a6-8e1b-e1f6a7501cf1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:51.311802 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-6d52c52c-7fff-47a6-8e1b-e1f6a7501cf1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:51.319556 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6d52c52c-7fff-47a6-8e1b-e1f6a7501cf1 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1512 microversion: 2.1 time: 0.147187 Feb 21 01:35:51.320108 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 269/515] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:51 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1512 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:51.532016 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-163f6bdd-8f83-4705-b907-a1e559df56a0 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:51.532747 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-163f6bdd-8f83-4705-b907-a1e559df56a0 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:51.538746 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-163f6bdd-8f83-4705-b907-a1e559df56a0 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:51.539201 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-163f6bdd-8f83-4705-b907-a1e559df56a0 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:51.540023 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-163f6bdd-8f83-4705-b907-a1e559df56a0 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:51.540599 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-163f6bdd-8f83-4705-b907-a1e559df56a0 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:51.674303 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-163f6bdd-8f83-4705-b907-a1e559df56a0 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:51.682549 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-163f6bdd-8f83-4705-b907-a1e559df56a0 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.156777 Feb 21 01:35:51.683144 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 247/516] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:51 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:51.986847 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cac169d5-0310-4c98-bc65-028525aed574 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:51.987450 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cac169d5-0310-4c98-bc65-028525aed574 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:51.993711 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cac169d5-0310-4c98-bc65-028525aed574 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:51.994152 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cac169d5-0310-4c98-bc65-028525aed574 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:51.994915 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cac169d5-0310-4c98-bc65-028525aed574 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:51.995344 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cac169d5-0310-4c98-bc65-028525aed574 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:52.210251 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-cac169d5-0310-4c98-bc65-028525aed574 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:52.217371 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cac169d5-0310-4c98-bc65-028525aed574 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1358 microversion: 2.1 time: 0.234130 Feb 21 01:35:52.217966 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 270/517] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:51 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:52.336614 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d27f8d9a-5032-42b6-89ad-618830254194 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:52.339620 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d27f8d9a-5032-42b6-89ad-618830254194 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:52.344563 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d27f8d9a-5032-42b6-89ad-618830254194 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:52.345127 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d27f8d9a-5032-42b6-89ad-618830254194 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:52.346042 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d27f8d9a-5032-42b6-89ad-618830254194 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:52.346552 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d27f8d9a-5032-42b6-89ad-618830254194 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:52.447808 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-d27f8d9a-5032-42b6-89ad-618830254194 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:52.453916 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-8302bed4-75a7-4a32-84af-79c56352c661 req-cd0a5308-adfa-4c3d-b0c1-d58f010e3f04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1", "name": "network-vif-deleted", "tag": "28fa7cb5-9fec-4840-adcc-939e35d2843b"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:35:52.455737 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:35:52.455737 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:35:52.459719 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d27f8d9a-5032-42b6-89ad-618830254194 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1470 microversion: 2.1 time: 0.127255 Feb 21 01:35:52.460616 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 248/518] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:52 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1470 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:52.470470 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-8302bed4-75a7-4a32-84af-79c56352c661 req-cd0a5308-adfa-4c3d-b0c1-d58f010e3f04 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:52.470928 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-8302bed4-75a7-4a32-84af-79c56352c661 req-cd0a5308-adfa-4c3d-b0c1-d58f010e3f04 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:52.482031 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-8302bed4-75a7-4a32-84af-79c56352c661 req-cd0a5308-adfa-4c3d-b0c1-d58f010e3f04 service nova] Creating event network-vif-deleted:28fa7cb5-9fec-4840-adcc-939e35d2843b for instance a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 on hv-cinder-81322 Feb 21 01:35:52.486931 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-8302bed4-75a7-4a32-84af-79c56352c661 req-cd0a5308-adfa-4c3d-b0c1-d58f010e3f04 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042232 Feb 21 01:35:52.487519 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 271/519] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:35:52.699485 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2096418d-332f-4e99-bd6e-ff20e991b391 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:52.700024 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2096418d-332f-4e99-bd6e-ff20e991b391 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:52.706082 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2096418d-332f-4e99-bd6e-ff20e991b391 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:52.706519 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2096418d-332f-4e99-bd6e-ff20e991b391 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:52.714036 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2096418d-332f-4e99-bd6e-ff20e991b391 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:52.714036 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2096418d-332f-4e99-bd6e-ff20e991b391 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:52.842897 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-2096418d-332f-4e99-bd6e-ff20e991b391 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:52.850273 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2096418d-332f-4e99-bd6e-ff20e991b391 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.154515 Feb 21 01:35:52.850834 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 249/520] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:52 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:53.234799 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1176b291-78c8-4a8b-935f-d67d175a8e60 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:53.235483 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1176b291-78c8-4a8b-935f-d67d175a8e60 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:53.242395 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1176b291-78c8-4a8b-935f-d67d175a8e60 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:53.242955 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1176b291-78c8-4a8b-935f-d67d175a8e60 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:53.243729 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1176b291-78c8-4a8b-935f-d67d175a8e60 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:53.244162 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1176b291-78c8-4a8b-935f-d67d175a8e60 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:53.375572 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1176b291-78c8-4a8b-935f-d67d175a8e60 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:53.382818 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1176b291-78c8-4a8b-935f-d67d175a8e60 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1358 microversion: 2.1 time: 0.151959 Feb 21 01:35:53.383373 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 272/521] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:53 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:53.476716 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3f98cedb-0a00-4cd6-9ece-219a123b2a29 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:53.477336 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3f98cedb-0a00-4cd6-9ece-219a123b2a29 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:53.483561 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f98cedb-0a00-4cd6-9ece-219a123b2a29 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:53.484010 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f98cedb-0a00-4cd6-9ece-219a123b2a29 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:53.484872 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f98cedb-0a00-4cd6-9ece-219a123b2a29 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:53.485251 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f98cedb-0a00-4cd6-9ece-219a123b2a29 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:53.516735 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f98cedb-0a00-4cd6-9ece-219a123b2a29 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:53.517186 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3f98cedb-0a00-4cd6-9ece-219a123b2a29 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:53.517699 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-3f98cedb-0a00-4cd6-9ece-219a123b2a29 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lazy-loading 'fault' on Instance uuid a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:35:53.556212 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-3f98cedb-0a00-4cd6-9ece-219a123b2a29 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:53.562789 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3f98cedb-0a00-4cd6-9ece-219a123b2a29 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 200 len: 1307 microversion: 2.1 time: 0.090371 Feb 21 01:35:53.563429 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 250/522] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:53 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:53.867363 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-877ad2bd-7d2b-4998-a852-b60be61b14aa tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:53.867999 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-877ad2bd-7d2b-4998-a852-b60be61b14aa tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:53.873907 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-877ad2bd-7d2b-4998-a852-b60be61b14aa tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:53.874353 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-877ad2bd-7d2b-4998-a852-b60be61b14aa tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:53.875119 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-877ad2bd-7d2b-4998-a852-b60be61b14aa tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:53.875547 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-877ad2bd-7d2b-4998-a852-b60be61b14aa tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:54.007982 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-877ad2bd-7d2b-4998-a852-b60be61b14aa tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:54.015414 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-877ad2bd-7d2b-4998-a852-b60be61b14aa tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.152255 Feb 21 01:35:54.015975 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 273/523] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:53 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:54.398977 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cdc7073c-d5ec-4221-9bc9-a030279c216b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:54.399593 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cdc7073c-d5ec-4221-9bc9-a030279c216b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:54.405435 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cdc7073c-d5ec-4221-9bc9-a030279c216b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:54.405880 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cdc7073c-d5ec-4221-9bc9-a030279c216b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:54.406646 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cdc7073c-d5ec-4221-9bc9-a030279c216b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:54.407078 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cdc7073c-d5ec-4221-9bc9-a030279c216b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:54.534418 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-cdc7073c-d5ec-4221-9bc9-a030279c216b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:54.541509 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cdc7073c-d5ec-4221-9bc9-a030279c216b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1358 microversion: 2.1 time: 0.146183 Feb 21 01:35:54.542149 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 251/524] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:54 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:35:54.579153 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-de609d4d-1755-463c-8fb6-81702afb180a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:54.579750 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-de609d4d-1755-463c-8fb6-81702afb180a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:54.585519 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de609d4d-1755-463c-8fb6-81702afb180a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:54.585959 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de609d4d-1755-463c-8fb6-81702afb180a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:54.586712 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de609d4d-1755-463c-8fb6-81702afb180a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:54.587136 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de609d4d-1755-463c-8fb6-81702afb180a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:54.599689 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-de609d4d-1755-463c-8fb6-81702afb180a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] HTTP exception thrown: Instance a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 could not be found. Feb 21 01:35:54.600244 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-de609d4d-1755-463c-8fb6-81702afb180a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Returning 404 to user: Instance a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:35:54.601056 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-de609d4d-1755-463c-8fb6-81702afb180a tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1" status: 404 len: 111 microversion: 2.1 time: 0.025481 Feb 21 01:35:54.601566 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 274/525] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:54 2022] GET /compute/v2.1/servers/a54c48d5-a909-4f1a-9b1e-a0c9c61cb4b1 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:35:54.609160 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6f4e8375-eb28-4116-b4d4-49439444b974 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:54.609662 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6f4e8375-eb28-4116-b4d4-49439444b974 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 41a646dd-0c47-4fe4-8727-3fe9925c80c7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:54.615976 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f4e8375-eb28-4116-b4d4-49439444b974 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:54.616441 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f4e8375-eb28-4116-b4d4-49439444b974 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:54.617275 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f4e8375-eb28-4116-b4d4-49439444b974 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:54.617722 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6f4e8375-eb28-4116-b4d4-49439444b974 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:54.642635 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6f4e8375-eb28-4116-b4d4-49439444b974 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 41a646dd-0c47-4fe4-8727-3fe9925c80c7] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:35:54.839744 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6f4e8375-eb28-4116-b4d4-49439444b974 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "DELETE /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7" status: 204 len: 0 microversion: 2.1 time: 0.233842 Feb 21 01:35:54.840441 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 252/526] 10.222.0.90 () {58 vars in 1238 bytes} [Mon Feb 21 01:35:54 2022] DELETE /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:35:54.849698 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-11f1c9cc-d839-4c2f-9994-56988418f36c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:54.850418 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-11f1c9cc-d839-4c2f-9994-56988418f36c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 41a646dd-0c47-4fe4-8727-3fe9925c80c7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:54.856326 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11f1c9cc-d839-4c2f-9994-56988418f36c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:54.856802 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11f1c9cc-d839-4c2f-9994-56988418f36c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:54.857581 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11f1c9cc-d839-4c2f-9994-56988418f36c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:54.858012 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11f1c9cc-d839-4c2f-9994-56988418f36c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:54.987846 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-11f1c9cc-d839-4c2f-9994-56988418f36c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:54.995621 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-11f1c9cc-d839-4c2f-9994-56988418f36c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7" status: 200 len: 1513 microversion: 2.1 time: 0.150811 Feb 21 01:35:54.996185 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 275/527] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:54 2022] GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:35:55.032273 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b20a720b-f57e-4be4-9a46-691ae8e68231 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:55.033024 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b20a720b-f57e-4be4-9a46-691ae8e68231 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:55.039399 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b20a720b-f57e-4be4-9a46-691ae8e68231 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:55.039844 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b20a720b-f57e-4be4-9a46-691ae8e68231 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:55.040636 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b20a720b-f57e-4be4-9a46-691ae8e68231 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:55.041067 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b20a720b-f57e-4be4-9a46-691ae8e68231 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:55.172135 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-b20a720b-f57e-4be4-9a46-691ae8e68231 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:55.179348 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b20a720b-f57e-4be4-9a46-691ae8e68231 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.151038 Feb 21 01:35:55.179905 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 253/528] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:55 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:55.558185 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-741f29ec-4763-4323-b916-4db837706ec6 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:55.558790 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-741f29ec-4763-4323-b916-4db837706ec6 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:55.564598 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-741f29ec-4763-4323-b916-4db837706ec6 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:55.565047 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-741f29ec-4763-4323-b916-4db837706ec6 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:55.565813 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-741f29ec-4763-4323-b916-4db837706ec6 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:55.566250 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-741f29ec-4763-4323-b916-4db837706ec6 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:55.698054 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-741f29ec-4763-4323-b916-4db837706ec6 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:55.705216 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-741f29ec-4763-4323-b916-4db837706ec6 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1358 microversion: 2.1 time: 0.150679 Feb 21 01:35:55.715054 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 276/529] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:55 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:56.012488 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-71e16581-63e7-478e-9b21-cc97931d1627 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:56.013959 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-71e16581-63e7-478e-9b21-cc97931d1627 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 41a646dd-0c47-4fe4-8727-3fe9925c80c7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:56.020595 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71e16581-63e7-478e-9b21-cc97931d1627 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:56.021050 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71e16581-63e7-478e-9b21-cc97931d1627 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:56.022039 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71e16581-63e7-478e-9b21-cc97931d1627 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:56.022683 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-71e16581-63e7-478e-9b21-cc97931d1627 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:56.195481 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c8bd9596-fd52-41aa-9265-27f23f695a45 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:56.196099 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c8bd9596-fd52-41aa-9265-27f23f695a45 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:56.203325 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8bd9596-fd52-41aa-9265-27f23f695a45 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:56.204014 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8bd9596-fd52-41aa-9265-27f23f695a45 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:56.205752 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8bd9596-fd52-41aa-9265-27f23f695a45 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:56.206337 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8bd9596-fd52-41aa-9265-27f23f695a45 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:56.290825 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-71e16581-63e7-478e-9b21-cc97931d1627 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:56.298687 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-71e16581-63e7-478e-9b21-cc97931d1627 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7" status: 200 len: 1513 microversion: 2.1 time: 0.290318 Feb 21 01:35:56.308766 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 254/530] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:56 2022] GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7 => generated 1513 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:56.413948 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-c8bd9596-fd52-41aa-9265-27f23f695a45 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:56.424413 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c8bd9596-fd52-41aa-9265-27f23f695a45 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1522 microversion: 2.1 time: 0.230720 Feb 21 01:35:56.425022 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 277/531] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:56 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:35:56.580276 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-64a171aa-943d-40e5-bb7e-a7a934f78b84 req-61651009-3372-49b4-b161-2a9bcb06bd2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5323990-b38c-44dd-812e-e5b7b3fd1ea9", "name": "network-vif-deleted", "tag": "cf21197e-c8ae-4d32-9844-138c1e440316"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:35:56.582057 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:35:56.582057 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:35:56.589537 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-64a171aa-943d-40e5-bb7e-a7a934f78b84 req-61651009-3372-49b4-b161-2a9bcb06bd2b service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:56.589976 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-64a171aa-943d-40e5-bb7e-a7a934f78b84 req-61651009-3372-49b4-b161-2a9bcb06bd2b service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:56.601445 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-64a171aa-943d-40e5-bb7e-a7a934f78b84 req-61651009-3372-49b4-b161-2a9bcb06bd2b service nova] Creating event network-vif-deleted:cf21197e-c8ae-4d32-9844-138c1e440316 for instance c5323990-b38c-44dd-812e-e5b7b3fd1ea9 on hv-cinder-81322 Feb 21 01:35:56.606188 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-64a171aa-943d-40e5-bb7e-a7a934f78b84 req-61651009-3372-49b4-b161-2a9bcb06bd2b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029629 Feb 21 01:35:56.610380 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 255/532] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:35:56.723092 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-199150b7-2bd9-46e3-808c-6225c957a280 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:56.726174 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-199150b7-2bd9-46e3-808c-6225c957a280 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:56.730852 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-199150b7-2bd9-46e3-808c-6225c957a280 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:56.730944 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-199150b7-2bd9-46e3-808c-6225c957a280 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:56.731727 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-199150b7-2bd9-46e3-808c-6225c957a280 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:56.732162 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-199150b7-2bd9-46e3-808c-6225c957a280 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:56.876625 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-199150b7-2bd9-46e3-808c-6225c957a280 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:56.884257 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-199150b7-2bd9-46e3-808c-6225c957a280 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1358 microversion: 2.1 time: 0.164562 Feb 21 01:35:56.884848 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 278/533] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:56 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:57.316732 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ff1d5e23-2e6f-45a2-9e0d-0b8bac5571cd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:57.318047 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ff1d5e23-2e6f-45a2-9e0d-0b8bac5571cd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 41a646dd-0c47-4fe4-8727-3fe9925c80c7] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:57.323944 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff1d5e23-2e6f-45a2-9e0d-0b8bac5571cd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:57.324384 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff1d5e23-2e6f-45a2-9e0d-0b8bac5571cd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:57.325169 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff1d5e23-2e6f-45a2-9e0d-0b8bac5571cd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:57.325591 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ff1d5e23-2e6f-45a2-9e0d-0b8bac5571cd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:57.441968 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f25a5fa6-b6c3-4660-a0b6-a9437e10d1ec tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:57.443173 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f25a5fa6-b6c3-4660-a0b6-a9437e10d1ec tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:57.449007 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f25a5fa6-b6c3-4660-a0b6-a9437e10d1ec tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:57.449457 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f25a5fa6-b6c3-4660-a0b6-a9437e10d1ec tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:57.450241 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f25a5fa6-b6c3-4660-a0b6-a9437e10d1ec tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:57.450676 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f25a5fa6-b6c3-4660-a0b6-a9437e10d1ec tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:57.477206 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ff1d5e23-2e6f-45a2-9e0d-0b8bac5571cd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:57.480126 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f25a5fa6-b6c3-4660-a0b6-a9437e10d1ec tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:57.480614 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f25a5fa6-b6c3-4660-a0b6-a9437e10d1ec tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:57.481058 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-f25a5fa6-b6c3-4660-a0b6-a9437e10d1ec tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lazy-loading 'fault' on Instance uuid c5323990-b38c-44dd-812e-e5b7b3fd1ea9 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:35:57.484490 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ff1d5e23-2e6f-45a2-9e0d-0b8bac5571cd tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7" status: 200 len: 1513 microversion: 2.1 time: 0.172083 Feb 21 01:35:57.485086 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 256/534] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:57 2022] GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:57.524750 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-f25a5fa6-b6c3-4660-a0b6-a9437e10d1ec tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f213f03b8c094202b25d6a1fcccb5994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa11c817930e42c49bb0f242205952d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:57.532510 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f25a5fa6-b6c3-4660-a0b6-a9437e10d1ec tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 200 len: 1312 microversion: 2.1 time: 0.094375 Feb 21 01:35:57.533054 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 279/535] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:57 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:35:57.900810 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ffefb5f0-2d43-4181-9799-f9cee8c6d9a7 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:57.901421 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ffefb5f0-2d43-4181-9799-f9cee8c6d9a7 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:57.907271 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ffefb5f0-2d43-4181-9799-f9cee8c6d9a7 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:57.907716 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ffefb5f0-2d43-4181-9799-f9cee8c6d9a7 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:57.908500 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ffefb5f0-2d43-4181-9799-f9cee8c6d9a7 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:57.908923 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ffefb5f0-2d43-4181-9799-f9cee8c6d9a7 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:58.111561 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ffefb5f0-2d43-4181-9799-f9cee8c6d9a7 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:58.118648 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ffefb5f0-2d43-4181-9799-f9cee8c6d9a7 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1358 microversion: 2.1 time: 0.221431 Feb 21 01:35:58.119202 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 257/536] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:57 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:58.501441 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b327e05d-2dbb-4380-a802-b4f947cb503c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:58.502053 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b327e05d-2dbb-4380-a802-b4f947cb503c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 41a646dd-0c47-4fe4-8727-3fe9925c80c7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:58.508505 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b327e05d-2dbb-4380-a802-b4f947cb503c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:58.509217 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b327e05d-2dbb-4380-a802-b4f947cb503c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:58.509993 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b327e05d-2dbb-4380-a802-b4f947cb503c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:58.510429 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b327e05d-2dbb-4380-a802-b4f947cb503c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:58.549306 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e59bcdd4-934b-4fc4-8dea-b4284a0c5cd9 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:58.549886 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e59bcdd4-934b-4fc4-8dea-b4284a0c5cd9 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] [instance: c5323990-b38c-44dd-812e-e5b7b3fd1ea9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:58.556214 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e59bcdd4-934b-4fc4-8dea-b4284a0c5cd9 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:58.561032 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e59bcdd4-934b-4fc4-8dea-b4284a0c5cd9 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:58.561032 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e59bcdd4-934b-4fc4-8dea-b4284a0c5cd9 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:58.561032 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e59bcdd4-934b-4fc4-8dea-b4284a0c5cd9 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:58.572405 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b327e05d-2dbb-4380-a802-b4f947cb503c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:58.573015 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-e59bcdd4-934b-4fc4-8dea-b4284a0c5cd9 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] HTTP exception thrown: Instance c5323990-b38c-44dd-812e-e5b7b3fd1ea9 could not be found. Feb 21 01:35:58.573619 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e59bcdd4-934b-4fc4-8dea-b4284a0c5cd9 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] Returning 404 to user: Instance c5323990-b38c-44dd-812e-e5b7b3fd1ea9 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:35:58.574444 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e59bcdd4-934b-4fc4-8dea-b4284a0c5cd9 tempest-ServerRescueNegativeTestJSON-1268015231 tempest-ServerRescueNegativeTestJSON-1268015231-project] 10.222.0.90 "GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9" status: 404 len: 111 microversion: 2.1 time: 0.029066 Feb 21 01:35:58.575187 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 258/537] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:58 2022] GET /compute/v2.1/servers/c5323990-b38c-44dd-812e-e5b7b3fd1ea9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 21 01:35:58.581455 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b327e05d-2dbb-4380-a802-b4f947cb503c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7" status: 200 len: 1302 microversion: 2.1 time: 0.083565 Feb 21 01:35:58.582182 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 280/538] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:58 2022] GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7 => generated 1302 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:35:58.635761 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-fa95c756-5351-49b6-8c52-014ff5173102 req-6e549c0e-c1ea-458d-8489-bc09bc048cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41a646dd-0c47-4fe4-8727-3fe9925c80c7", "name": "network-vif-deleted", "tag": "08712441-0ce7-4bec-af4d-4a2f88e466db"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:35:58.637382 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:35:58.637382 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:35:58.644288 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-fa95c756-5351-49b6-8c52-014ff5173102 req-6e549c0e-c1ea-458d-8489-bc09bc048cb5 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:58.645436 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-fa95c756-5351-49b6-8c52-014ff5173102 req-6e549c0e-c1ea-458d-8489-bc09bc048cb5 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:58.657219 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-fa95c756-5351-49b6-8c52-014ff5173102 req-6e549c0e-c1ea-458d-8489-bc09bc048cb5 service nova] Creating event network-vif-deleted:08712441-0ce7-4bec-af4d-4a2f88e466db for instance 41a646dd-0c47-4fe4-8727-3fe9925c80c7 on hv-cinder-81322 Feb 21 01:35:58.662210 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-fa95c756-5351-49b6-8c52-014ff5173102 req-6e549c0e-c1ea-458d-8489-bc09bc048cb5 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030309 Feb 21 01:35:58.662916 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 259/539] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:35:59.135965 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b977e355-6819-4953-854e-376d62ef7ba9 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:59.136619 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b977e355-6819-4953-854e-376d62ef7ba9 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:59.143431 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b977e355-6819-4953-854e-376d62ef7ba9 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:59.143882 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b977e355-6819-4953-854e-376d62ef7ba9 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:59.145054 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b977e355-6819-4953-854e-376d62ef7ba9 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:59.145495 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b977e355-6819-4953-854e-376d62ef7ba9 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:59.370466 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-049869a5-4a66-4ca4-a822-edb3a5ab3b6a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a331acc5-865a-4eb2-ab52-68364af9726c"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:35:59.371620 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-049869a5-4a66-4ca4-a822-edb3a5ab3b6a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:59.377610 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-049869a5-4a66-4ca4-a822-edb3a5ab3b6a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:59.378048 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-049869a5-4a66-4ca4-a822-edb3a5ab3b6a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:59.378811 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-049869a5-4a66-4ca4-a822-edb3a5ab3b6a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:59.379232 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-049869a5-4a66-4ca4-a822-edb3a5ab3b6a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:59.575525 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b977e355-6819-4953-854e-376d62ef7ba9 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:35:59.582850 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b977e355-6819-4953-854e-376d62ef7ba9 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1358 microversion: 2.1 time: 0.451072 Feb 21 01:35:59.583693 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 281/540] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:59 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1358 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:35:59.598755 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-230476af-1333-4209-bd7a-42275f285840 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:35:59.599374 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-230476af-1333-4209-bd7a-42275f285840 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 41a646dd-0c47-4fe4-8727-3fe9925c80c7] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:35:59.606242 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-230476af-1333-4209-bd7a-42275f285840 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:59.606242 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-230476af-1333-4209-bd7a-42275f285840 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:59.606745 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-230476af-1333-4209-bd7a-42275f285840 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:35:59.607181 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-230476af-1333-4209-bd7a-42275f285840 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:35:59.624931 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-230476af-1333-4209-bd7a-42275f285840 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] HTTP exception thrown: Instance 41a646dd-0c47-4fe4-8727-3fe9925c80c7 could not be found. Feb 21 01:35:59.625525 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-230476af-1333-4209-bd7a-42275f285840 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Returning 404 to user: Instance 41a646dd-0c47-4fe4-8727-3fe9925c80c7 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:35:59.626374 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-230476af-1333-4209-bd7a-42275f285840 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7" status: 404 len: 111 microversion: 2.1 time: 0.031296 Feb 21 01:35:59.626925 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 282/541] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:35:59 2022] GET /compute/v2.1/servers/41a646dd-0c47-4fe4-8727-3fe9925c80c7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:35:59.997555 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-049869a5-4a66-4ca4-a822-edb3a5ab3b6a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "POST /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.631065 Feb 21 01:36:00.002301 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 260/542] 10.222.0.90 () {60 vars in 1322 bytes} [Mon Feb 21 01:35:59 2022] POST /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd/os-volume_attachments => generated 194 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:36:00.097666 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-de961cee-b379-471e-9655-0ca3af5f11cf req-04677046-6d67-48a4-af39-bb7c13fd1b71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b613c437-8337-4ce8-82d9-843cd6ccbc04", "name": "network-vif-plugged", "status": "completed", "tag": "3c272f96-f321-4ccf-a91e-d7d0afd792b2"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:36:00.099611 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:36:00.099611 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:36:00.118441 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-de961cee-b379-471e-9655-0ca3af5f11cf req-04677046-6d67-48a4-af39-bb7c13fd1b71 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:00.118441 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-de961cee-b379-471e-9655-0ca3af5f11cf req-04677046-6d67-48a4-af39-bb7c13fd1b71 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:00.128381 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-de961cee-b379-471e-9655-0ca3af5f11cf req-04677046-6d67-48a4-af39-bb7c13fd1b71 service nova] Creating event network-vif-plugged:3c272f96-f321-4ccf-a91e-d7d0afd792b2 for instance b613c437-8337-4ce8-82d9-843cd6ccbc04 on hv-cinder-81322 Feb 21 01:36:00.134936 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-de961cee-b379-471e-9655-0ca3af5f11cf req-04677046-6d67-48a4-af39-bb7c13fd1b71 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040656 Feb 21 01:36:00.135618 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 283/543] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:36:00.600415 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0d3bc883-015a-4958-946a-3683245528b2 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:00.601412 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0d3bc883-015a-4958-946a-3683245528b2 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:00.608287 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d3bc883-015a-4958-946a-3683245528b2 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:00.608823 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d3bc883-015a-4958-946a-3683245528b2 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:00.609611 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d3bc883-015a-4958-946a-3683245528b2 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:00.610048 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d3bc883-015a-4958-946a-3683245528b2 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:00.766453 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-0d3bc883-015a-4958-946a-3683245528b2 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:00.776239 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0d3bc883-015a-4958-946a-3683245528b2 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1358 microversion: 2.1 time: 0.180582 Feb 21 01:36:00.777584 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 261/544] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:00 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:00.898333 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-04b5e4fe-d5cf-4d52-a22f-3a6583c472ae tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:00.899497 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-04b5e4fe-d5cf-4d52-a22f-3a6583c472ae tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:00.906046 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04b5e4fe-d5cf-4d52-a22f-3a6583c472ae tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:00.906496 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04b5e4fe-d5cf-4d52-a22f-3a6583c472ae tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:00.907331 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04b5e4fe-d5cf-4d52-a22f-3a6583c472ae tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:00.907776 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-04b5e4fe-d5cf-4d52-a22f-3a6583c472ae tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:00.934699 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-04b5e4fe-d5cf-4d52-a22f-3a6583c472ae tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:36:01.216785 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-04b5e4fe-d5cf-4d52-a22f-3a6583c472ae tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "DELETE /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 204 len: 0 microversion: 2.1 time: 0.322177 Feb 21 01:36:01.217677 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 284/545] 10.222.0.90 () {58 vars in 1238 bytes} [Mon Feb 21 01:36:00 2022] DELETE /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:36:01.227189 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d05b61d4-2b0e-4f94-8298-c2b793f7e92c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:01.228135 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d05b61d4-2b0e-4f94-8298-c2b793f7e92c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:01.236209 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d05b61d4-2b0e-4f94-8298-c2b793f7e92c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:01.237085 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d05b61d4-2b0e-4f94-8298-c2b793f7e92c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:01.242748 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d05b61d4-2b0e-4f94-8298-c2b793f7e92c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:01.243298 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d05b61d4-2b0e-4f94-8298-c2b793f7e92c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:01.380388 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-d05b61d4-2b0e-4f94-8298-c2b793f7e92c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:01.388738 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d05b61d4-2b0e-4f94-8298-c2b793f7e92c tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1512 microversion: 2.1 time: 0.166573 Feb 21 01:36:01.389323 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 262/546] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:01 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:01.796257 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2003baf2-52d9-4d2b-b06c-86da86ca3eca tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:01.797074 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2003baf2-52d9-4d2b-b06c-86da86ca3eca tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:01.804346 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2003baf2-52d9-4d2b-b06c-86da86ca3eca tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:01.804964 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2003baf2-52d9-4d2b-b06c-86da86ca3eca tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:01.805827 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2003baf2-52d9-4d2b-b06c-86da86ca3eca tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:01.806325 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2003baf2-52d9-4d2b-b06c-86da86ca3eca tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:02.017914 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2003baf2-52d9-4d2b-b06c-86da86ca3eca tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:02.029150 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2003baf2-52d9-4d2b-b06c-86da86ca3eca tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1358 microversion: 2.1 time: 0.238852 Feb 21 01:36:02.029714 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 285/547] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:01 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:02.406792 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c0524ddf-c702-45b9-a58c-1655b15a4efb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:02.407404 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c0524ddf-c702-45b9-a58c-1655b15a4efb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:02.414530 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c0524ddf-c702-45b9-a58c-1655b15a4efb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:02.414974 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c0524ddf-c702-45b9-a58c-1655b15a4efb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:02.415741 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c0524ddf-c702-45b9-a58c-1655b15a4efb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:02.416169 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c0524ddf-c702-45b9-a58c-1655b15a4efb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:02.563945 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c0524ddf-c702-45b9-a58c-1655b15a4efb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:02.571913 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c0524ddf-c702-45b9-a58c-1655b15a4efb tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1512 microversion: 2.1 time: 0.168742 Feb 21 01:36:02.572547 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 263/548] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:02 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:03.045971 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a3dd8eb0-bc6d-48d5-9f59-93b4e9f95f3b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:03.046680 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a3dd8eb0-bc6d-48d5-9f59-93b4e9f95f3b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:03.058877 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a3dd8eb0-bc6d-48d5-9f59-93b4e9f95f3b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:03.059567 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a3dd8eb0-bc6d-48d5-9f59-93b4e9f95f3b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:03.060697 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a3dd8eb0-bc6d-48d5-9f59-93b4e9f95f3b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:03.061342 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a3dd8eb0-bc6d-48d5-9f59-93b4e9f95f3b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:03.211523 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-a3dd8eb0-bc6d-48d5-9f59-93b4e9f95f3b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:03.219066 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a3dd8eb0-bc6d-48d5-9f59-93b4e9f95f3b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1548 microversion: 2.1 time: 0.177122 Feb 21 01:36:03.219741 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 286/549] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:03 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1548 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:03.235864 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0ac8ea41-a331-49c1-8963-8e988a36c33d tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:03.236575 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0ac8ea41-a331-49c1-8963-8e988a36c33d tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:03.242409 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ac8ea41-a331-49c1-8963-8e988a36c33d tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:03.243189 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ac8ea41-a331-49c1-8963-8e988a36c33d tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:03.243736 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ac8ea41-a331-49c1-8963-8e988a36c33d tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:03.244170 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ac8ea41-a331-49c1-8963-8e988a36c33d tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:03.347096 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e6ef6350-d503-4a1d-8774-3b4599970ed1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:36:03.348133 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e6ef6350-d503-4a1d-8774-3b4599970ed1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:03.353896 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6ef6350-d503-4a1d-8774-3b4599970ed1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:03.354407 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6ef6350-d503-4a1d-8774-3b4599970ed1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:03.355381 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6ef6350-d503-4a1d-8774-3b4599970ed1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:03.355807 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e6ef6350-d503-4a1d-8774-3b4599970ed1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:03.379670 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-0ac8ea41-a331-49c1-8963-8e988a36c33d tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:03.382058 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-e6ef6350-d503-4a1d-8774-3b4599970ed1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lazy-loading 'flavor' on Instance uuid 962b0526-5a3e-4044-a74f-34fe41f7717d {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:36:03.389268 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0ac8ea41-a331-49c1-8963-8e988a36c33d tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1548 microversion: 2.1 time: 0.157131 Feb 21 01:36:03.391334 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 264/550] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:03 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:03.415615 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-40cc6d2a-db29-40c3-9410-c75fcd7a70da tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:03.419016 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:36:03.419016 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:36:03.419993 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-40cc6d2a-db29-40c3-9410-c75fcd7a70da tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:03.420760 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-40cc6d2a-db29-40c3-9410-c75fcd7a70da tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Searching by: {'deleted': False, 'project_id': '784f5427745d402ba47e692082aac30f'} {{(pid=123542) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 21 01:36:03.428404 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40cc6d2a-db29-40c3-9410-c75fcd7a70da tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:03.428877 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40cc6d2a-db29-40c3-9410-c75fcd7a70da tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:03.429673 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40cc6d2a-db29-40c3-9410-c75fcd7a70da tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:03.430101 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40cc6d2a-db29-40c3-9410-c75fcd7a70da tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:03.520384 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.multi_cell_list [None req-40cc6d2a-db29-40c3-9410-c75fcd7a70da tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 21 01:36:03.617774 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-40cc6d2a-db29-40c3-9410-c75fcd7a70da tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.207300 Feb 21 01:36:03.623597 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 265/551] 10.222.0.90 () {58 vars in 1124 bytes} [Mon Feb 21 01:36:03 2022] GET /compute/v2.1/servers => generated 342 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:36:03.623597 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2a54935e-c48b-4002-b9bc-14c9865cb136 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:03.624516 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2a54935e-c48b-4002-b9bc-14c9865cb136 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:03.629662 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a54935e-c48b-4002-b9bc-14c9865cb136 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:03.630112 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a54935e-c48b-4002-b9bc-14c9865cb136 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:03.631455 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a54935e-c48b-4002-b9bc-14c9865cb136 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:03.632029 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a54935e-c48b-4002-b9bc-14c9865cb136 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:03.783787 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-2a54935e-c48b-4002-b9bc-14c9865cb136 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:03.795374 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2a54935e-c48b-4002-b9bc-14c9865cb136 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1512 microversion: 2.1 time: 0.176006 Feb 21 01:36:03.798486 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 266/552] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:03 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1512 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:03.811131 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f75be566-2115-46b6-9f28-7413f1a189c8 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:03.813046 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f75be566-2115-46b6-9f28-7413f1a189c8 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:03.823234 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f75be566-2115-46b6-9f28-7413f1a189c8 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:03.823690 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f75be566-2115-46b6-9f28-7413f1a189c8 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:03.827422 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f75be566-2115-46b6-9f28-7413f1a189c8 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:03.827422 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f75be566-2115-46b6-9f28-7413f1a189c8 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:03.924761 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e6ef6350-d503-4a1d-8774-3b4599970ed1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "POST /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d/action" status: 202 len: 0 microversion: 2.20 time: 0.581124 Feb 21 01:36:03.929331 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 287/553] 10.222.0.90 () {62 vars in 1318 bytes} [Mon Feb 21 01:36:03 2022] POST /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d/action => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 21 01:36:03.934699 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-844da0e6-ff98-4f1c-813e-23a1b8d1495c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:03.935921 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-844da0e6-ff98-4f1c-813e-23a1b8d1495c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:03.941884 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-844da0e6-ff98-4f1c-813e-23a1b8d1495c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:03.942323 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-844da0e6-ff98-4f1c-813e-23a1b8d1495c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:03.947999 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-844da0e6-ff98-4f1c-813e-23a1b8d1495c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:03.947999 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-844da0e6-ff98-4f1c-813e-23a1b8d1495c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:04.155835 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-f75be566-2115-46b6-9f28-7413f1a189c8 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:04.165580 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f75be566-2115-46b6-9f28-7413f1a189c8 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1548 microversion: 2.1 time: 0.364942 Feb 21 01:36:04.166167 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 267/554] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:03 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1548 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:04.213389 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-844da0e6-ff98-4f1c-813e-23a1b8d1495c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:04.232303 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-844da0e6-ff98-4f1c-813e-23a1b8d1495c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:04.234385 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-844da0e6-ff98-4f1c-813e-23a1b8d1495c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:04.235644 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-844da0e6-ff98-4f1c-813e-23a1b8d1495c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1722 microversion: 2.20 time: 0.304843 Feb 21 01:36:04.236413 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 288/555] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:03 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1722 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:36:04.535553 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-6f3d7400-78de-42b7-bf55-d0d25eef81c5 req-eee62ff3-2c0d-4120-b31b-39d6f72fb61a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d88f85-1d15-4f12-a8e7-f3b531088d5e", "name": "network-vif-deleted", "tag": "8dcff3a2-5327-4c3f-9f70-590bf220865d"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:36:04.537014 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:36:04.537014 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:36:04.544500 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6f3d7400-78de-42b7-bf55-d0d25eef81c5 req-eee62ff3-2c0d-4120-b31b-39d6f72fb61a service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:04.544951 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6f3d7400-78de-42b7-bf55-d0d25eef81c5 req-eee62ff3-2c0d-4120-b31b-39d6f72fb61a service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:04.555696 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-6f3d7400-78de-42b7-bf55-d0d25eef81c5 req-eee62ff3-2c0d-4120-b31b-39d6f72fb61a service nova] Creating event network-vif-deleted:8dcff3a2-5327-4c3f-9f70-590bf220865d for instance 58d88f85-1d15-4f12-a8e7-f3b531088d5e on hv-cinder-81322 Feb 21 01:36:04.560781 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-6f3d7400-78de-42b7-bf55-d0d25eef81c5 req-eee62ff3-2c0d-4120-b31b-39d6f72fb61a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028735 Feb 21 01:36:04.561373 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 268/556] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:36:04.813774 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-922ee083-6655-47d5-a965-4529b7cabfc0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:04.814487 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-922ee083-6655-47d5-a965-4529b7cabfc0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:04.827106 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-922ee083-6655-47d5-a965-4529b7cabfc0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:04.827697 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-922ee083-6655-47d5-a965-4529b7cabfc0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:04.828523 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-922ee083-6655-47d5-a965-4529b7cabfc0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:04.828966 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-922ee083-6655-47d5-a965-4529b7cabfc0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:04.860067 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-922ee083-6655-47d5-a965-4529b7cabfc0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:04.860595 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-922ee083-6655-47d5-a965-4529b7cabfc0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:04.861052 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-922ee083-6655-47d5-a965-4529b7cabfc0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lazy-loading 'fault' on Instance uuid 58d88f85-1d15-4f12-a8e7-f3b531088d5e {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:36:04.903427 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-922ee083-6655-47d5-a965-4529b7cabfc0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d4828335a543758d1413c0276657a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d99a6bb8ad42a980e51a57fcec7315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:04.910952 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-922ee083-6655-47d5-a965-4529b7cabfc0 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 200 len: 1307 microversion: 2.1 time: 0.101394 Feb 21 01:36:04.911898 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 289/557] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:04 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:05.254316 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b02d1658-46ad-42f9-a278-03c9c4c731e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:05.255120 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b02d1658-46ad-42f9-a278-03c9c4c731e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:05.261473 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b02d1658-46ad-42f9-a278-03c9c4c731e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:05.261994 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b02d1658-46ad-42f9-a278-03c9c4c731e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:05.262769 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b02d1658-46ad-42f9-a278-03c9c4c731e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:05.263194 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b02d1658-46ad-42f9-a278-03c9c4c731e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:05.437054 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-b02d1658-46ad-42f9-a278-03c9c4c731e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:05.447447 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-b02d1658-46ad-42f9-a278-03c9c4c731e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:05.449002 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-b02d1658-46ad-42f9-a278-03c9c4c731e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:05.450170 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b02d1658-46ad-42f9-a278-03c9c4c731e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1722 microversion: 2.20 time: 0.199890 Feb 21 01:36:05.450734 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 269/558] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:05 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:05.927015 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-53867417-1b02-4bb2-bb04-8852648bf7c2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:05.927623 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-53867417-1b02-4bb2-bb04-8852648bf7c2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] [instance: 58d88f85-1d15-4f12-a8e7-f3b531088d5e] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:05.933316 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53867417-1b02-4bb2-bb04-8852648bf7c2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:05.933808 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53867417-1b02-4bb2-bb04-8852648bf7c2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:05.934575 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53867417-1b02-4bb2-bb04-8852648bf7c2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:05.935010 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-53867417-1b02-4bb2-bb04-8852648bf7c2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:05.948571 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-53867417-1b02-4bb2-bb04-8852648bf7c2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] HTTP exception thrown: Instance 58d88f85-1d15-4f12-a8e7-f3b531088d5e could not be found. Feb 21 01:36:05.949290 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-53867417-1b02-4bb2-bb04-8852648bf7c2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] Returning 404 to user: Instance 58d88f85-1d15-4f12-a8e7-f3b531088d5e could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:36:05.950102 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-53867417-1b02-4bb2-bb04-8852648bf7c2 tempest-AttachVolumeNegativeTest-337757454 tempest-AttachVolumeNegativeTest-337757454-project] 10.222.0.90 "GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e" status: 404 len: 111 microversion: 2.1 time: 0.026782 Feb 21 01:36:05.950617 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 290/559] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:05 2022] GET /compute/v2.1/servers/58d88f85-1d15-4f12-a8e7-f3b531088d5e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:36:06.251552 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cbfb1b76-5019-4976-b8cb-74c98b9f5cfb tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1709284650", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1144935184", "security_groups": [{"name": "tempest-secgroup-smoke-160534230"}], "networks": [{"uuid": "487fa038-40fd-45ef-934d-8902aea996a9"}], "block_device_mapping_v2": [{"uuid": "6d0ef4fa-f0ea-4073-9eb4-e5da80700381", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:36:06.363130 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-cbfb1b76-5019-4976-b8cb-74c98b9f5cfb tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] validate_networks() for [('487fa038-40fd-45ef-934d-8902aea996a9', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:36:06.471145 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-87d22a77-6e10-4afa-af01-481bc8aea561 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:06.471145 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-87d22a77-6e10-4afa-af01-481bc8aea561 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:06.477374 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87d22a77-6e10-4afa-af01-481bc8aea561 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:06.485209 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87d22a77-6e10-4afa-af01-481bc8aea561 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:06.485209 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87d22a77-6e10-4afa-af01-481bc8aea561 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:06.485209 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87d22a77-6e10-4afa-af01-481bc8aea561 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:06.965115 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-87d22a77-6e10-4afa-af01-481bc8aea561 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:06.973014 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-87d22a77-6e10-4afa-af01-481bc8aea561 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:06.975043 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-87d22a77-6e10-4afa-af01-481bc8aea561 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:06.976200 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-87d22a77-6e10-4afa-af01-481bc8aea561 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1722 microversion: 2.20 time: 0.510747 Feb 21 01:36:06.976984 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 291/560] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:06 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1722 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:36:07.051104 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fda10c76-a9d9-43c5-a665-b04782fdffcc tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1a53b8e-96e6-4d25-876b-5a68332eb2a3"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:36:07.052762 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fda10c76-a9d9-43c5-a665-b04782fdffcc tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:07.059378 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fda10c76-a9d9-43c5-a665-b04782fdffcc tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:07.059951 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fda10c76-a9d9-43c5-a665-b04782fdffcc tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:07.060869 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fda10c76-a9d9-43c5-a665-b04782fdffcc tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:07.061572 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fda10c76-a9d9-43c5-a665-b04782fdffcc tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:07.085768 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-cbfb1b76-5019-4976-b8cb-74c98b9f5cfb tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:36:07.086503 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-cbfb1b76-5019-4976-b8cb-74c98b9f5cfb tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:36:07.087140 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-cbfb1b76-5019-4976-b8cb-74c98b9f5cfb tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:36:07.096689 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-cbfb1b76-5019-4976-b8cb-74c98b9f5cfb tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:36:07.097277 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-cbfb1b76-5019-4976-b8cb-74c98b9f5cfb tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:36:07.108010 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cbfb1b76-5019-4976-b8cb-74c98b9f5cfb tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:07.108579 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cbfb1b76-5019-4976-b8cb-74c98b9f5cfb tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:07.109449 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cbfb1b76-5019-4976-b8cb-74c98b9f5cfb tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:07.109949 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cbfb1b76-5019-4976-b8cb-74c98b9f5cfb tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:07.139211 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-cbfb1b76-5019-4976-b8cb-74c98b9f5cfb tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Getting quotas for project 360e1042eb3f47f5be6a603e1877d9d8. Resources: {'ram', 'cores', 'instances'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:36:07.147273 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-cbfb1b76-5019-4976-b8cb-74c98b9f5cfb tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Getting quotas for user 07356563a079427b97e47ce2a11b54b7 and project 360e1042eb3f47f5be6a603e1877d9d8. Resources: {'ram', 'cores', 'instances'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:36:07.219345 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cbfb1b76-5019-4976-b8cb-74c98b9f5cfb tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:36:07.221561 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cbfb1b76-5019-4976-b8cb-74c98b9f5cfb tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6d0ef4fa-f0ea-4073-9eb4-e5da80700381',volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:36:07.817335 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cbfb1b76-5019-4976-b8cb-74c98b9f5cfb tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [2effc945-c1ed-49be-9566-836aa9407e7d] AMQP server on 10.222.0.90:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 21 01:36:08.157851 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fda10c76-a9d9-43c5-a665-b04782fdffcc tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "POST /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.105324 Feb 21 01:36:08.157851 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 292/561] 10.222.0.90 () {60 vars in 1322 bytes} [Mon Feb 21 01:36:07 2022] POST /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04/os-volume_attachments => generated 194 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:36:08.158336 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7aa2e223-b12f-4f4e-963e-bf85f56d2b04 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:08.159010 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7aa2e223-b12f-4f4e-963e-bf85f56d2b04 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:08.166638 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7aa2e223-b12f-4f4e-963e-bf85f56d2b04 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:08.167487 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7aa2e223-b12f-4f4e-963e-bf85f56d2b04 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:08.167857 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7aa2e223-b12f-4f4e-963e-bf85f56d2b04 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:08.168279 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7aa2e223-b12f-4f4e-963e-bf85f56d2b04 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:08.312363 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-7aa2e223-b12f-4f4e-963e-bf85f56d2b04 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:08.323997 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-7aa2e223-b12f-4f4e-963e-bf85f56d2b04 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:08.323997 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-7aa2e223-b12f-4f4e-963e-bf85f56d2b04 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:08.324486 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7aa2e223-b12f-4f4e-963e-bf85f56d2b04 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1722 microversion: 2.20 time: 0.170038 Feb 21 01:36:08.325150 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 293/562] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:08 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:08.774051 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-065f88ee-ce0f-4977-af2a-fdf197b077fa tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:36:08.780979 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-065f88ee-ce0f-4977-af2a-fdf197b077fa tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:08.781442 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-065f88ee-ce0f-4977-af2a-fdf197b077fa tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:08.826548 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [None req-cbfb1b76-5019-4976-b8cb-74c98b9f5cfb tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [2effc945-c1ed-49be-9566-836aa9407e7d] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 55594. Feb 21 01:36:08.834186 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cbfb1b76-5019-4976-b8cb-74c98b9f5cfb tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.586395 Feb 21 01:36:08.836965 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 270/563] 10.222.0.90 () {60 vars in 1146 bytes} [Mon Feb 21 01:36:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 2590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:36:08.849955 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-065f88ee-ce0f-4977-af2a-fdf197b077fa tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Going to try to stop instance {{(pid=123541) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 21 01:36:08.852309 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-846d542b-db62-46a5-9098-511b2fca7f9e tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:08.854977 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-846d542b-db62-46a5-9098-511b2fca7f9e tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:08.944266 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-846d542b-db62-46a5-9098-511b2fca7f9e tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:08.951459 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-846d542b-db62-46a5-9098-511b2fca7f9e tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1089 microversion: 2.1 time: 0.104571 Feb 21 01:36:08.952340 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 271/564] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:08 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1089 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:09.043200 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-065f88ee-ce0f-4977-af2a-fdf197b077fa tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "POST /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd/action" status: 202 len: 0 microversion: 2.1 time: 0.272646 Feb 21 01:36:09.043844 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 294/565] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Feb 21 01:36:08 2022] POST /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 21 01:36:09.056633 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-59aca126-798a-4761-8f7e-299db089d55d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:09.057524 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-59aca126-798a-4761-8f7e-299db089d55d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:09.063674 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59aca126-798a-4761-8f7e-299db089d55d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:09.064120 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59aca126-798a-4761-8f7e-299db089d55d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:09.064933 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59aca126-798a-4761-8f7e-299db089d55d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:09.065361 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59aca126-798a-4761-8f7e-299db089d55d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:09.225101 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-59aca126-798a-4761-8f7e-299db089d55d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:09.235349 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-59aca126-798a-4761-8f7e-299db089d55d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1722 microversion: 2.1 time: 0.186452 Feb 21 01:36:09.237643 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 272/566] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:09 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:09.343348 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-de2c4246-2517-4587-8ebc-09f358fe63aa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:09.344299 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-de2c4246-2517-4587-8ebc-09f358fe63aa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:09.355497 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de2c4246-2517-4587-8ebc-09f358fe63aa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:09.356193 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de2c4246-2517-4587-8ebc-09f358fe63aa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:09.358108 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de2c4246-2517-4587-8ebc-09f358fe63aa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:09.359203 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-de2c4246-2517-4587-8ebc-09f358fe63aa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:09.515447 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-de2c4246-2517-4587-8ebc-09f358fe63aa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:09.525095 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-de2c4246-2517-4587-8ebc-09f358fe63aa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:09.526909 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-de2c4246-2517-4587-8ebc-09f358fe63aa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:09.528302 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-de2c4246-2517-4587-8ebc-09f358fe63aa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1722 microversion: 2.20 time: 0.189256 Feb 21 01:36:09.528978 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 295/567] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:09 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:09.969164 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cc0deded-07bb-4993-a06b-5a6e1323ae28 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:09.969885 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cc0deded-07bb-4993-a06b-5a6e1323ae28 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:09.978227 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc0deded-07bb-4993-a06b-5a6e1323ae28 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:09.978747 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc0deded-07bb-4993-a06b-5a6e1323ae28 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:09.979658 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc0deded-07bb-4993-a06b-5a6e1323ae28 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:09.980832 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc0deded-07bb-4993-a06b-5a6e1323ae28 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:10.044922 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-cc0deded-07bb-4993-a06b-5a6e1323ae28 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:10.052307 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cc0deded-07bb-4993-a06b-5a6e1323ae28 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1139 microversion: 2.1 time: 0.086813 Feb 21 01:36:10.052903 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 273/568] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:09 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:36:10.254146 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4b4a173b-3a5f-422c-8489-6798f45fb8c9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:10.254672 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4b4a173b-3a5f-422c-8489-6798f45fb8c9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:10.261486 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b4a173b-3a5f-422c-8489-6798f45fb8c9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:10.261941 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b4a173b-3a5f-422c-8489-6798f45fb8c9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:10.262718 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b4a173b-3a5f-422c-8489-6798f45fb8c9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:10.263158 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b4a173b-3a5f-422c-8489-6798f45fb8c9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:10.398758 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-4b4a173b-3a5f-422c-8489-6798f45fb8c9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:10.408715 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4b4a173b-3a5f-422c-8489-6798f45fb8c9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1722 microversion: 2.1 time: 0.158157 Feb 21 01:36:10.409295 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 296/569] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:10 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:10.546560 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-996ed615-36f6-416c-a0dd-911b6338cf6b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:10.547160 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-996ed615-36f6-416c-a0dd-911b6338cf6b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:10.553035 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-996ed615-36f6-416c-a0dd-911b6338cf6b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:10.553476 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-996ed615-36f6-416c-a0dd-911b6338cf6b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:10.554255 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-996ed615-36f6-416c-a0dd-911b6338cf6b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:10.554686 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-996ed615-36f6-416c-a0dd-911b6338cf6b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:10.686717 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-996ed615-36f6-416c-a0dd-911b6338cf6b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:10.694836 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-996ed615-36f6-416c-a0dd-911b6338cf6b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:10.696309 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-996ed615-36f6-416c-a0dd-911b6338cf6b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:10.697454 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-996ed615-36f6-416c-a0dd-911b6338cf6b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1722 microversion: 2.20 time: 0.154618 Feb 21 01:36:10.698006 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 274/570] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:10 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:11.069328 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2d3f1b06-124a-4448-8b1c-d584a5778e06 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:11.069944 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2d3f1b06-124a-4448-8b1c-d584a5778e06 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:11.075636 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d3f1b06-124a-4448-8b1c-d584a5778e06 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:11.076089 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d3f1b06-124a-4448-8b1c-d584a5778e06 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:11.076891 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d3f1b06-124a-4448-8b1c-d584a5778e06 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:11.077329 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d3f1b06-124a-4448-8b1c-d584a5778e06 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:11.160995 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2d3f1b06-124a-4448-8b1c-d584a5778e06 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:11.169068 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2d3f1b06-124a-4448-8b1c-d584a5778e06 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1139 microversion: 2.1 time: 0.104080 Feb 21 01:36:11.169866 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 297/571] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:11 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1139 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:11.425662 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-627ba6a3-9e83-4bba-9b8d-a3d5b2dbd2ed tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:11.426268 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-627ba6a3-9e83-4bba-9b8d-a3d5b2dbd2ed tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:11.433405 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-627ba6a3-9e83-4bba-9b8d-a3d5b2dbd2ed tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:11.433852 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-627ba6a3-9e83-4bba-9b8d-a3d5b2dbd2ed tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:11.434687 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-627ba6a3-9e83-4bba-9b8d-a3d5b2dbd2ed tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:11.435123 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-627ba6a3-9e83-4bba-9b8d-a3d5b2dbd2ed tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:11.567049 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-627ba6a3-9e83-4bba-9b8d-a3d5b2dbd2ed tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:11.574775 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-627ba6a3-9e83-4bba-9b8d-a3d5b2dbd2ed tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1722 microversion: 2.1 time: 0.152659 Feb 21 01:36:11.575285 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 275/572] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:11 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:11.715022 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bdc91582-59ed-48fa-b846-392498921534 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:11.715630 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bdc91582-59ed-48fa-b846-392498921534 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:11.721831 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bdc91582-59ed-48fa-b846-392498921534 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:11.722273 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bdc91582-59ed-48fa-b846-392498921534 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:11.723037 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bdc91582-59ed-48fa-b846-392498921534 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:11.723467 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bdc91582-59ed-48fa-b846-392498921534 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:11.861884 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-bdc91582-59ed-48fa-b846-392498921534 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:11.869487 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-bdc91582-59ed-48fa-b846-392498921534 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:11.871453 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-bdc91582-59ed-48fa-b846-392498921534 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:11.872639 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bdc91582-59ed-48fa-b846-392498921534 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1722 microversion: 2.20 time: 0.161283 Feb 21 01:36:11.873196 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 298/573] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:11 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:12.186134 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a1ca831b-edf8-4279-a12f-b7b6a5201bf3 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:12.186741 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a1ca831b-edf8-4279-a12f-b7b6a5201bf3 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:12.192980 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1ca831b-edf8-4279-a12f-b7b6a5201bf3 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:12.193458 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1ca831b-edf8-4279-a12f-b7b6a5201bf3 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:12.194222 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1ca831b-edf8-4279-a12f-b7b6a5201bf3 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:12.194864 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a1ca831b-edf8-4279-a12f-b7b6a5201bf3 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:12.259178 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-a1ca831b-edf8-4279-a12f-b7b6a5201bf3 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:12.266854 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a1ca831b-edf8-4279-a12f-b7b6a5201bf3 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1139 microversion: 2.1 time: 0.084245 Feb 21 01:36:12.305551 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 276/574] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:12 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:12.592319 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9001d6fb-ad11-4a4a-b68f-0b7e025a373a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:12.593108 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9001d6fb-ad11-4a4a-b68f-0b7e025a373a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:12.598901 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9001d6fb-ad11-4a4a-b68f-0b7e025a373a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:12.599343 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9001d6fb-ad11-4a4a-b68f-0b7e025a373a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:12.600092 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9001d6fb-ad11-4a4a-b68f-0b7e025a373a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:12.600554 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9001d6fb-ad11-4a4a-b68f-0b7e025a373a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:12.737048 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-9001d6fb-ad11-4a4a-b68f-0b7e025a373a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:12.745283 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9001d6fb-ad11-4a4a-b68f-0b7e025a373a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1722 microversion: 2.1 time: 0.156653 Feb 21 01:36:12.748873 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 299/575] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:12 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:12.891006 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-040f574e-81e8-40a2-a191-6a044ff382af tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:12.891614 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-040f574e-81e8-40a2-a191-6a044ff382af tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:12.898442 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-040f574e-81e8-40a2-a191-6a044ff382af tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:12.898889 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-040f574e-81e8-40a2-a191-6a044ff382af tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:12.899655 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-040f574e-81e8-40a2-a191-6a044ff382af tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:12.900086 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-040f574e-81e8-40a2-a191-6a044ff382af tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:13.031468 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-040f574e-81e8-40a2-a191-6a044ff382af tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:13.039539 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-040f574e-81e8-40a2-a191-6a044ff382af tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:13.041085 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-040f574e-81e8-40a2-a191-6a044ff382af tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:13.042234 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-040f574e-81e8-40a2-a191-6a044ff382af tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1722 microversion: 2.20 time: 0.155011 Feb 21 01:36:13.042792 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 277/576] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:12 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:13.296840 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1be0cb53-0135-4925-be4d-5f385bd527ab tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:13.297453 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1be0cb53-0135-4925-be4d-5f385bd527ab tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:13.303740 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1be0cb53-0135-4925-be4d-5f385bd527ab tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:13.304193 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1be0cb53-0135-4925-be4d-5f385bd527ab tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:13.304987 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1be0cb53-0135-4925-be4d-5f385bd527ab tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:13.305450 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1be0cb53-0135-4925-be4d-5f385bd527ab tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:13.376235 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1be0cb53-0135-4925-be4d-5f385bd527ab tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:13.384459 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1be0cb53-0135-4925-be4d-5f385bd527ab tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1139 microversion: 2.1 time: 0.091019 Feb 21 01:36:13.385037 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 300/577] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:13 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1139 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:13.762020 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-665876b4-c3eb-4c96-81d3-6ee71edae86a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:13.764230 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-665876b4-c3eb-4c96-81d3-6ee71edae86a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:13.768418 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-665876b4-c3eb-4c96-81d3-6ee71edae86a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:13.768891 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-665876b4-c3eb-4c96-81d3-6ee71edae86a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:13.769655 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-665876b4-c3eb-4c96-81d3-6ee71edae86a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:13.770087 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-665876b4-c3eb-4c96-81d3-6ee71edae86a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:13.905103 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-665876b4-c3eb-4c96-81d3-6ee71edae86a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:13.913771 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-665876b4-c3eb-4c96-81d3-6ee71edae86a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1722 microversion: 2.1 time: 0.155545 Feb 21 01:36:13.914332 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 278/578] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:13 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:14.061364 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8a71572d-0e13-4821-9cb1-18e9eaaf0ea4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:14.061964 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8a71572d-0e13-4821-9cb1-18e9eaaf0ea4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:14.068178 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a71572d-0e13-4821-9cb1-18e9eaaf0ea4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:14.068659 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a71572d-0e13-4821-9cb1-18e9eaaf0ea4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:14.069425 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a71572d-0e13-4821-9cb1-18e9eaaf0ea4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:14.069856 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8a71572d-0e13-4821-9cb1-18e9eaaf0ea4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:14.205970 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-8a71572d-0e13-4821-9cb1-18e9eaaf0ea4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:14.214099 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-8a71572d-0e13-4821-9cb1-18e9eaaf0ea4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:14.215579 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-8a71572d-0e13-4821-9cb1-18e9eaaf0ea4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:14.216731 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8a71572d-0e13-4821-9cb1-18e9eaaf0ea4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1722 microversion: 2.20 time: 0.159073 Feb 21 01:36:14.217282 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 301/579] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:14 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:14.406625 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-53a2bffd-92ce-441e-9e25-b698008edacb tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:14.406625 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-53a2bffd-92ce-441e-9e25-b698008edacb tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:14.411567 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53a2bffd-92ce-441e-9e25-b698008edacb tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:14.412011 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53a2bffd-92ce-441e-9e25-b698008edacb tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:14.412812 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53a2bffd-92ce-441e-9e25-b698008edacb tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:14.413240 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-53a2bffd-92ce-441e-9e25-b698008edacb tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:14.472932 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-53a2bffd-92ce-441e-9e25-b698008edacb tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:14.480313 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-53a2bffd-92ce-441e-9e25-b698008edacb tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1187 microversion: 2.1 time: 0.078852 Feb 21 01:36:14.481246 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 279/580] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:14 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1187 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:14.931245 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f526d936-29ff-4e3a-8407-9f672539cd8d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:14.931858 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f526d936-29ff-4e3a-8407-9f672539cd8d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:14.937815 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f526d936-29ff-4e3a-8407-9f672539cd8d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:14.938270 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f526d936-29ff-4e3a-8407-9f672539cd8d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:14.939047 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f526d936-29ff-4e3a-8407-9f672539cd8d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:14.939482 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f526d936-29ff-4e3a-8407-9f672539cd8d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:15.190145 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-f526d936-29ff-4e3a-8407-9f672539cd8d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:15.198409 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f526d936-29ff-4e3a-8407-9f672539cd8d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1722 microversion: 2.1 time: 0.271414 Feb 21 01:36:15.198971 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 302/581] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:14 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:15.234351 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-90cb6dcb-fd9e-4d29-bc4c-89040728fc06 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:15.235005 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-90cb6dcb-fd9e-4d29-bc4c-89040728fc06 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:15.242206 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-90cb6dcb-fd9e-4d29-bc4c-89040728fc06 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:15.250036 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-90cb6dcb-fd9e-4d29-bc4c-89040728fc06 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:15.250036 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-90cb6dcb-fd9e-4d29-bc4c-89040728fc06 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:15.250036 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-90cb6dcb-fd9e-4d29-bc4c-89040728fc06 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:15.460396 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-90cb6dcb-fd9e-4d29-bc4c-89040728fc06 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:15.468213 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-90cb6dcb-fd9e-4d29-bc4c-89040728fc06 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:15.469720 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-90cb6dcb-fd9e-4d29-bc4c-89040728fc06 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:15.470852 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-90cb6dcb-fd9e-4d29-bc4c-89040728fc06 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1722 microversion: 2.20 time: 0.240154 Feb 21 01:36:15.471444 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 280/582] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:15 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:15.496755 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c4219dd8-e91c-4ffc-8a98-dba9a7539f6d tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:15.497362 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c4219dd8-e91c-4ffc-8a98-dba9a7539f6d tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:15.503152 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4219dd8-e91c-4ffc-8a98-dba9a7539f6d tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:15.506935 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4219dd8-e91c-4ffc-8a98-dba9a7539f6d tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:15.506935 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4219dd8-e91c-4ffc-8a98-dba9a7539f6d tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:15.506935 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4219dd8-e91c-4ffc-8a98-dba9a7539f6d tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:15.706865 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-c4219dd8-e91c-4ffc-8a98-dba9a7539f6d tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:15.713586 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c4219dd8-e91c-4ffc-8a98-dba9a7539f6d tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1272 microversion: 2.1 time: 0.220411 Feb 21 01:36:15.714616 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 303/583] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:15 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1272 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:16.215640 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5b7be46e-6088-447e-b68e-e86c8b40f02e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:16.216604 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5b7be46e-6088-447e-b68e-e86c8b40f02e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:16.222162 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b7be46e-6088-447e-b68e-e86c8b40f02e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:16.222611 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b7be46e-6088-447e-b68e-e86c8b40f02e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:16.223401 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b7be46e-6088-447e-b68e-e86c8b40f02e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:16.224557 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5b7be46e-6088-447e-b68e-e86c8b40f02e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:16.449721 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-5b7be46e-6088-447e-b68e-e86c8b40f02e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:16.458798 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5b7be46e-6088-447e-b68e-e86c8b40f02e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1722 microversion: 2.1 time: 0.246801 Feb 21 01:36:16.468906 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 281/584] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:16 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:16.488808 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8785b85e-7e9d-4579-a6f2-017dde4ce7a8 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:16.489410 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8785b85e-7e9d-4579-a6f2-017dde4ce7a8 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:16.495855 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8785b85e-7e9d-4579-a6f2-017dde4ce7a8 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:16.496274 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8785b85e-7e9d-4579-a6f2-017dde4ce7a8 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:16.497127 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8785b85e-7e9d-4579-a6f2-017dde4ce7a8 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:16.497565 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8785b85e-7e9d-4579-a6f2-017dde4ce7a8 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:16.564662 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-11739b22-a646-4e87-a6da-bdc1d274c85d req-ed6054b5-0dc0-4f1f-9df0-1c870f5dff81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bfdab9d-ba0f-4923-ad4e-40ef23db9338", "tag": "682a620b-646c-4dfa-8198-bae01e8d1e36"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:36:16.566885 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:36:16.566885 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:36:16.577068 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-11739b22-a646-4e87-a6da-bdc1d274c85d req-ed6054b5-0dc0-4f1f-9df0-1c870f5dff81 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:16.580756 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-11739b22-a646-4e87-a6da-bdc1d274c85d req-ed6054b5-0dc0-4f1f-9df0-1c870f5dff81 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:16.598022 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-11739b22-a646-4e87-a6da-bdc1d274c85d req-ed6054b5-0dc0-4f1f-9df0-1c870f5dff81 service nova] Creating event network-changed:682a620b-646c-4dfa-8198-bae01e8d1e36 for instance 3bfdab9d-ba0f-4923-ad4e-40ef23db9338 on hv-cinder-81322 Feb 21 01:36:16.607245 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-11739b22-a646-4e87-a6da-bdc1d274c85d req-ed6054b5-0dc0-4f1f-9df0-1c870f5dff81 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045933 Feb 21 01:36:16.608560 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 282/585] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:36:16.727602 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-8785b85e-7e9d-4579-a6f2-017dde4ce7a8 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:16.740292 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-8785b85e-7e9d-4579-a6f2-017dde4ce7a8 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:16.740457 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-22760907-a536-497e-aa24-bf9d071ac607 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:16.749936 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-22760907-a536-497e-aa24-bf9d071ac607 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:16.750304 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-8785b85e-7e9d-4579-a6f2-017dde4ce7a8 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:16.750304 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8785b85e-7e9d-4579-a6f2-017dde4ce7a8 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1722 microversion: 2.20 time: 0.259151 Feb 21 01:36:16.750304 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 304/586] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:16 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:16.750586 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22760907-a536-497e-aa24-bf9d071ac607 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:16.750586 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22760907-a536-497e-aa24-bf9d071ac607 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:16.750586 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22760907-a536-497e-aa24-bf9d071ac607 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:16.750586 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-22760907-a536-497e-aa24-bf9d071ac607 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:16.803017 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3e60adda-c5ef-4818-9ef8-2c7171f7f1fa tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:16.803560 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3e60adda-c5ef-4818-9ef8-2c7171f7f1fa tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:16.809342 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e60adda-c5ef-4818-9ef8-2c7171f7f1fa tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:16.812195 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e60adda-c5ef-4818-9ef8-2c7171f7f1fa tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:16.812195 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e60adda-c5ef-4818-9ef8-2c7171f7f1fa tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:16.812195 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e60adda-c5ef-4818-9ef8-2c7171f7f1fa tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:16.970124 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-22760907-a536-497e-aa24-bf9d071ac607 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:16.977495 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-22760907-a536-497e-aa24-bf9d071ac607 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1272 microversion: 2.1 time: 0.243299 Feb 21 01:36:16.978063 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 283/587] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:16 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1272 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:17.024718 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-3e60adda-c5ef-4818-9ef8-2c7171f7f1fa tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:17.033228 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3e60adda-c5ef-4818-9ef8-2c7171f7f1fa tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1594 microversion: 2.1 time: 0.234409 Feb 21 01:36:17.033810 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 305/588] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:16 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1594 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:36:17.476160 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fb4fbc3c-da0d-4531-b291-f430d83226cf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:17.480813 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fb4fbc3c-da0d-4531-b291-f430d83226cf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:17.483645 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb4fbc3c-da0d-4531-b291-f430d83226cf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:17.484198 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb4fbc3c-da0d-4531-b291-f430d83226cf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:17.485136 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb4fbc3c-da0d-4531-b291-f430d83226cf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:17.485658 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fb4fbc3c-da0d-4531-b291-f430d83226cf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:17.721583 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-fb4fbc3c-da0d-4531-b291-f430d83226cf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:17.729250 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fb4fbc3c-da0d-4531-b291-f430d83226cf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1722 microversion: 2.1 time: 0.256784 Feb 21 01:36:17.729811 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 284/589] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:17 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:17.766549 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ccee19c9-3a84-4efc-b62d-d84ba835b059 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:17.767157 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ccee19c9-3a84-4efc-b62d-d84ba835b059 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:17.773350 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ccee19c9-3a84-4efc-b62d-d84ba835b059 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:17.773803 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ccee19c9-3a84-4efc-b62d-d84ba835b059 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:17.774569 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ccee19c9-3a84-4efc-b62d-d84ba835b059 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:17.774993 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ccee19c9-3a84-4efc-b62d-d84ba835b059 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:17.995790 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4ef72a80-6337-445f-8e48-f04eec820eea tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:17.996412 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4ef72a80-6337-445f-8e48-f04eec820eea tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:18.002441 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ef72a80-6337-445f-8e48-f04eec820eea tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:18.002890 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ef72a80-6337-445f-8e48-f04eec820eea tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:18.003671 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ef72a80-6337-445f-8e48-f04eec820eea tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:18.004105 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4ef72a80-6337-445f-8e48-f04eec820eea tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:18.113788 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-ccee19c9-3a84-4efc-b62d-d84ba835b059 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:18.122167 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-ccee19c9-3a84-4efc-b62d-d84ba835b059 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:18.123696 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-ccee19c9-3a84-4efc-b62d-d84ba835b059 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:18.124947 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ccee19c9-3a84-4efc-b62d-d84ba835b059 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1722 microversion: 2.20 time: 0.362032 Feb 21 01:36:18.125429 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 306/590] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:17 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1722 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:18.609328 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-4ef72a80-6337-445f-8e48-f04eec820eea tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:18.616605 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4ef72a80-6337-445f-8e48-f04eec820eea tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1272 microversion: 2.1 time: 0.625853 Feb 21 01:36:18.617181 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 285/591] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:17 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1272 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:36:18.746574 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8fb1541c-57bf-4258-bb50-fbb65a16fca9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:18.747182 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8fb1541c-57bf-4258-bb50-fbb65a16fca9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:18.752990 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fb1541c-57bf-4258-bb50-fbb65a16fca9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:18.753487 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fb1541c-57bf-4258-bb50-fbb65a16fca9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:18.754257 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fb1541c-57bf-4258-bb50-fbb65a16fca9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:18.755196 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8fb1541c-57bf-4258-bb50-fbb65a16fca9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:18.975757 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-8fb1541c-57bf-4258-bb50-fbb65a16fca9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:18.985178 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8fb1541c-57bf-4258-bb50-fbb65a16fca9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1722 microversion: 2.1 time: 0.242327 Feb 21 01:36:18.986057 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 307/592] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:18 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:19.142957 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ed3009a3-28e9-47e1-b6b1-bd8d06a58bb9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:19.143585 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ed3009a3-28e9-47e1-b6b1-bd8d06a58bb9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:19.149634 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed3009a3-28e9-47e1-b6b1-bd8d06a58bb9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:19.150260 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed3009a3-28e9-47e1-b6b1-bd8d06a58bb9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:19.151221 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed3009a3-28e9-47e1-b6b1-bd8d06a58bb9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:19.151806 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ed3009a3-28e9-47e1-b6b1-bd8d06a58bb9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:19.402991 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ed3009a3-28e9-47e1-b6b1-bd8d06a58bb9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:19.410531 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ed3009a3-28e9-47e1-b6b1-bd8d06a58bb9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:19.412576 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ed3009a3-28e9-47e1-b6b1-bd8d06a58bb9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:19.413722 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ed3009a3-28e9-47e1-b6b1-bd8d06a58bb9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1722 microversion: 2.20 time: 0.274482 Feb 21 01:36:19.414280 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 286/593] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:19 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1722 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:19.635090 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-65135d4b-c4b9-4942-8639-11885eb5223e tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:19.635703 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-65135d4b-c4b9-4942-8639-11885eb5223e tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:19.650612 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65135d4b-c4b9-4942-8639-11885eb5223e tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:19.651000 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65135d4b-c4b9-4942-8639-11885eb5223e tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:19.651789 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65135d4b-c4b9-4942-8639-11885eb5223e tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:19.652220 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65135d4b-c4b9-4942-8639-11885eb5223e tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:19.757767 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-55a452c9-7c75-4c01-ae9f-62fdbea45c4b req-f36d369f-42ee-4cfc-b2e2-ad64fe900b8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b613c437-8337-4ce8-82d9-843cd6ccbc04", "tag": "3c272f96-f321-4ccf-a91e-d7d0afd792b2"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:36:19.760403 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:36:19.760403 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:36:19.769947 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-55a452c9-7c75-4c01-ae9f-62fdbea45c4b req-f36d369f-42ee-4cfc-b2e2-ad64fe900b8d service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:19.771169 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-55a452c9-7c75-4c01-ae9f-62fdbea45c4b req-f36d369f-42ee-4cfc-b2e2-ad64fe900b8d service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:19.789843 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-55a452c9-7c75-4c01-ae9f-62fdbea45c4b req-f36d369f-42ee-4cfc-b2e2-ad64fe900b8d service nova] Creating event network-changed:3c272f96-f321-4ccf-a91e-d7d0afd792b2 for instance b613c437-8337-4ce8-82d9-843cd6ccbc04 on hv-cinder-81322 Feb 21 01:36:19.795227 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-55a452c9-7c75-4c01-ae9f-62fdbea45c4b req-f36d369f-42ee-4cfc-b2e2-ad64fe900b8d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044210 Feb 21 01:36:19.796499 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 287/594] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:36:19.828919 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-65135d4b-c4b9-4942-8639-11885eb5223e tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:19.837576 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-65135d4b-c4b9-4942-8639-11885eb5223e tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1260 microversion: 2.1 time: 0.206321 Feb 21 01:36:19.838372 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 308/595] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:19 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1260 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:20.002713 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-859adb57-736e-4407-b2d6-a93df4cbf142 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:20.003630 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-859adb57-736e-4407-b2d6-a93df4cbf142 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:20.011421 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-859adb57-736e-4407-b2d6-a93df4cbf142 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:20.014916 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-859adb57-736e-4407-b2d6-a93df4cbf142 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:20.014916 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-859adb57-736e-4407-b2d6-a93df4cbf142 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:20.014916 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-859adb57-736e-4407-b2d6-a93df4cbf142 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:20.255042 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-859adb57-736e-4407-b2d6-a93df4cbf142 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:20.263534 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-859adb57-736e-4407-b2d6-a93df4cbf142 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1722 microversion: 2.1 time: 0.265578 Feb 21 01:36:20.264122 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 288/596] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:19 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:20.432000 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ab81b6c9-b919-42f4-8b08-ff6aaa24911b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:20.432785 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ab81b6c9-b919-42f4-8b08-ff6aaa24911b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:20.444102 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab81b6c9-b919-42f4-8b08-ff6aaa24911b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:20.444970 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab81b6c9-b919-42f4-8b08-ff6aaa24911b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:20.445362 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab81b6c9-b919-42f4-8b08-ff6aaa24911b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:20.445796 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ab81b6c9-b919-42f4-8b08-ff6aaa24911b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:20.783572 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-ab81b6c9-b919-42f4-8b08-ff6aaa24911b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:20.795767 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-ab81b6c9-b919-42f4-8b08-ff6aaa24911b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:20.798328 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-ab81b6c9-b919-42f4-8b08-ff6aaa24911b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:20.801271 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ab81b6c9-b919-42f4-8b08-ff6aaa24911b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1722 microversion: 2.20 time: 0.373156 Feb 21 01:36:20.802185 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 309/597] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:20 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1722 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:20.856578 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-642c6827-353f-4e21-94cd-ddff404e4c43 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:20.856578 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-642c6827-353f-4e21-94cd-ddff404e4c43 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:20.863407 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-642c6827-353f-4e21-94cd-ddff404e4c43 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:20.864113 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-642c6827-353f-4e21-94cd-ddff404e4c43 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:20.865174 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-642c6827-353f-4e21-94cd-ddff404e4c43 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:20.865713 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-642c6827-353f-4e21-94cd-ddff404e4c43 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:21.280720 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8dc38538-cff8-4dd0-8967-b40c437e916f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:21.281362 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8dc38538-cff8-4dd0-8967-b40c437e916f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:21.304473 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dc38538-cff8-4dd0-8967-b40c437e916f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:21.305024 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dc38538-cff8-4dd0-8967-b40c437e916f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:21.305943 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dc38538-cff8-4dd0-8967-b40c437e916f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:21.306805 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dc38538-cff8-4dd0-8967-b40c437e916f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:21.416782 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-642c6827-353f-4e21-94cd-ddff404e4c43 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:21.424547 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-642c6827-353f-4e21-94cd-ddff404e4c43 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1260 microversion: 2.1 time: 0.572454 Feb 21 01:36:21.425219 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 289/598] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:20 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1260 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:21.548923 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-8dc38538-cff8-4dd0-8967-b40c437e916f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:21.557423 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8dc38538-cff8-4dd0-8967-b40c437e916f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1722 microversion: 2.1 time: 0.280250 Feb 21 01:36:21.557858 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 310/599] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:21 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:21.820170 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d15d74ac-2d89-4cac-bc53-ee0f811493d9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:21.823331 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d15d74ac-2d89-4cac-bc53-ee0f811493d9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:21.826588 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d15d74ac-2d89-4cac-bc53-ee0f811493d9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:21.827212 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d15d74ac-2d89-4cac-bc53-ee0f811493d9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:21.827991 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d15d74ac-2d89-4cac-bc53-ee0f811493d9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:21.828872 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d15d74ac-2d89-4cac-bc53-ee0f811493d9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:21.986091 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-d15d74ac-2d89-4cac-bc53-ee0f811493d9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:21.995006 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-d15d74ac-2d89-4cac-bc53-ee0f811493d9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:21.995947 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-d15d74ac-2d89-4cac-bc53-ee0f811493d9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:21.997121 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d15d74ac-2d89-4cac-bc53-ee0f811493d9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1722 microversion: 2.20 time: 0.181981 Feb 21 01:36:21.997677 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 290/600] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:21 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:22.296157 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7361c7c8-86f4-46f5-9b4c-459f678be558 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1083368726"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:36:22.296791 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7361c7c8-86f4-46f5-9b4c-459f678be558 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:22.303321 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7361c7c8-86f4-46f5-9b4c-459f678be558 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:22.303771 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7361c7c8-86f4-46f5-9b4c-459f678be558 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:22.304584 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7361c7c8-86f4-46f5-9b4c-459f678be558 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:22.305013 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7361c7c8-86f4-46f5-9b4c-459f678be558 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:22.436291 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.network.security_group_api [None req-7361c7c8-86f4-46f5-9b4c-459f678be558 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Adding security group 9746bf9d-4fdc-43f3-8953-2b70074ef734 to port 3c272f96-f321-4ccf-a91e-d7d0afd792b2 Feb 21 01:36:22.442754 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-46bbae87-ea2d-47f7-9c2a-7e622ccdd783 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:22.443374 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-46bbae87-ea2d-47f7-9c2a-7e622ccdd783 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:22.449606 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46bbae87-ea2d-47f7-9c2a-7e622ccdd783 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:22.450060 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46bbae87-ea2d-47f7-9c2a-7e622ccdd783 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:22.450899 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46bbae87-ea2d-47f7-9c2a-7e622ccdd783 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:22.451334 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46bbae87-ea2d-47f7-9c2a-7e622ccdd783 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:22.680884 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-46bbae87-ea2d-47f7-9c2a-7e622ccdd783 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:22.688833 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-46bbae87-ea2d-47f7-9c2a-7e622ccdd783 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1260 microversion: 2.1 time: 0.250573 Feb 21 01:36:22.689711 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 291/601] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:22 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1260 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:36:22.694614 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cb3833d5-84dd-4758-b31b-45d7587e60bb tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:22.695377 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cb3833d5-84dd-4758-b31b-45d7587e60bb tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:22.701307 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb3833d5-84dd-4758-b31b-45d7587e60bb tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:22.701751 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb3833d5-84dd-4758-b31b-45d7587e60bb tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:22.702521 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb3833d5-84dd-4758-b31b-45d7587e60bb tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:22.703129 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb3833d5-84dd-4758-b31b-45d7587e60bb tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:22.923168 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-cb3833d5-84dd-4758-b31b-45d7587e60bb tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:22.931362 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cb3833d5-84dd-4758-b31b-45d7587e60bb tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1722 microversion: 2.1 time: 0.240547 Feb 21 01:36:22.931927 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 292/602] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:22 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:23.016287 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-138f20ef-df2b-4222-badd-2b05b0629d92 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:23.017484 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-138f20ef-df2b-4222-badd-2b05b0629d92 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:23.023255 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-138f20ef-df2b-4222-badd-2b05b0629d92 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:23.023850 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-138f20ef-df2b-4222-badd-2b05b0629d92 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:23.024845 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-138f20ef-df2b-4222-badd-2b05b0629d92 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:23.025286 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-138f20ef-df2b-4222-badd-2b05b0629d92 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:23.054021 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7361c7c8-86f4-46f5-9b4c-459f678be558 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "POST /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04/action" status: 202 len: 0 microversion: 2.1 time: 0.761510 Feb 21 01:36:23.055126 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 311/603] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Feb 21 01:36:22 2022] POST /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04/action => generated 0 bytes in 763 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:36:23.063149 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-be3da01a-34ee-4213-a699-788229308c0e tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:23.066815 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-be3da01a-34ee-4213-a699-788229308c0e tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:23.073799 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be3da01a-34ee-4213-a699-788229308c0e tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:23.074321 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be3da01a-34ee-4213-a699-788229308c0e tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:23.076187 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be3da01a-34ee-4213-a699-788229308c0e tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:23.076662 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-be3da01a-34ee-4213-a699-788229308c0e tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:23.330844 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-138f20ef-df2b-4222-badd-2b05b0629d92 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:23.341589 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-138f20ef-df2b-4222-badd-2b05b0629d92 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:23.343446 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-138f20ef-df2b-4222-badd-2b05b0629d92 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:23.344973 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-138f20ef-df2b-4222-badd-2b05b0629d92 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1722 microversion: 2.20 time: 0.334103 Feb 21 01:36:23.372688 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 293/604] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:23 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1722 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:23.373558 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-be3da01a-34ee-4213-a699-788229308c0e tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:23.381412 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-abb512ed-3887-4e47-8303-ed7863d47d76 req-9283a53f-cedc-460b-8ff3-2df751ee9b1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b613c437-8337-4ce8-82d9-843cd6ccbc04", "tag": "3c272f96-f321-4ccf-a91e-d7d0afd792b2"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:36:23.384674 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-be3da01a-34ee-4213-a699-788229308c0e tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1760 microversion: 2.1 time: 0.324656 Feb 21 01:36:23.385462 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 312/605] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:23 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1760 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:23.391470 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:36:23.391470 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:36:23.403936 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-abb512ed-3887-4e47-8303-ed7863d47d76 req-9283a53f-cedc-460b-8ff3-2df751ee9b1a service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:23.404636 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-abb512ed-3887-4e47-8303-ed7863d47d76 req-9283a53f-cedc-460b-8ff3-2df751ee9b1a service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:23.418058 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-abb512ed-3887-4e47-8303-ed7863d47d76 req-9283a53f-cedc-460b-8ff3-2df751ee9b1a service nova] Creating event network-changed:3c272f96-f321-4ccf-a91e-d7d0afd792b2 for instance b613c437-8337-4ce8-82d9-843cd6ccbc04 on hv-cinder-81322 Feb 21 01:36:23.424089 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-abb512ed-3887-4e47-8303-ed7863d47d76 req-9283a53f-cedc-460b-8ff3-2df751ee9b1a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049450 Feb 21 01:36:23.425429 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 294/606] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:36:23.706608 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a14af652-1068-4868-a888-39d937268542 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:23.707224 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a14af652-1068-4868-a888-39d937268542 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:23.719155 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a14af652-1068-4868-a888-39d937268542 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:23.719819 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a14af652-1068-4868-a888-39d937268542 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:23.720823 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a14af652-1068-4868-a888-39d937268542 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:23.721413 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a14af652-1068-4868-a888-39d937268542 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:23.951012 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fe9c3054-043a-4e0f-8099-0bb022c5a956 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:23.951859 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fe9c3054-043a-4e0f-8099-0bb022c5a956 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:23.955963 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-a14af652-1068-4868-a888-39d937268542 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:23.960493 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe9c3054-043a-4e0f-8099-0bb022c5a956 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:23.961284 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe9c3054-043a-4e0f-8099-0bb022c5a956 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:23.962283 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe9c3054-043a-4e0f-8099-0bb022c5a956 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:23.962973 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe9c3054-043a-4e0f-8099-0bb022c5a956 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:23.966417 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a14af652-1068-4868-a888-39d937268542 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1260 microversion: 2.1 time: 0.263473 Feb 21 01:36:23.976362 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 313/607] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:23 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1260 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:24.173295 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-fe9c3054-043a-4e0f-8099-0bb022c5a956 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:24.183335 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fe9c3054-043a-4e0f-8099-0bb022c5a956 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1722 microversion: 2.1 time: 0.236682 Feb 21 01:36:24.184541 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 295/608] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:23 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:24.364960 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c53f147b-0739-4ec4-ad69-5ceec0ab5a37 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:24.365476 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c53f147b-0739-4ec4-ad69-5ceec0ab5a37 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:24.371599 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c53f147b-0739-4ec4-ad69-5ceec0ab5a37 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:24.372058 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c53f147b-0739-4ec4-ad69-5ceec0ab5a37 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:24.372949 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c53f147b-0739-4ec4-ad69-5ceec0ab5a37 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:24.373382 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c53f147b-0739-4ec4-ad69-5ceec0ab5a37 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:24.504144 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-c53f147b-0739-4ec4-ad69-5ceec0ab5a37 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:24.513988 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-c53f147b-0739-4ec4-ad69-5ceec0ab5a37 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:24.515527 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-c53f147b-0739-4ec4-ad69-5ceec0ab5a37 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:24.516715 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c53f147b-0739-4ec4-ad69-5ceec0ab5a37 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1722 microversion: 2.20 time: 0.156124 Feb 21 01:36:24.517277 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 314/609] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:24 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:24.982695 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-68345043-770c-4b8d-bce7-6ed2df79d497 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:24.983405 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-68345043-770c-4b8d-bce7-6ed2df79d497 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:24.990133 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68345043-770c-4b8d-bce7-6ed2df79d497 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:24.990578 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68345043-770c-4b8d-bce7-6ed2df79d497 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:24.991353 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68345043-770c-4b8d-bce7-6ed2df79d497 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:24.991782 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-68345043-770c-4b8d-bce7-6ed2df79d497 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:25.127516 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-68345043-770c-4b8d-bce7-6ed2df79d497 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:25.135050 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-68345043-770c-4b8d-bce7-6ed2df79d497 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1260 microversion: 2.1 time: 0.155960 Feb 21 01:36:25.135612 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 296/610] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:24 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:25.203327 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1e7b4a8f-259c-472f-9bf3-94b5baf1764f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:25.204107 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1e7b4a8f-259c-472f-9bf3-94b5baf1764f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:25.210627 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e7b4a8f-259c-472f-9bf3-94b5baf1764f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:25.211088 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e7b4a8f-259c-472f-9bf3-94b5baf1764f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:25.211992 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e7b4a8f-259c-472f-9bf3-94b5baf1764f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:25.212458 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1e7b4a8f-259c-472f-9bf3-94b5baf1764f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:25.356729 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1e7b4a8f-259c-472f-9bf3-94b5baf1764f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:25.363031 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1e7b4a8f-259c-472f-9bf3-94b5baf1764f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1722 microversion: 2.1 time: 0.165956 Feb 21 01:36:25.365752 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 315/611] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:25 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:25.538354 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d6e28966-aa67-4a2a-aec6-9e93bdddf5cf tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:25.540392 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d6e28966-aa67-4a2a-aec6-9e93bdddf5cf tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:25.547789 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d6e28966-aa67-4a2a-aec6-9e93bdddf5cf tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:25.548618 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d6e28966-aa67-4a2a-aec6-9e93bdddf5cf tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:25.549437 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d6e28966-aa67-4a2a-aec6-9e93bdddf5cf tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:25.549942 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d6e28966-aa67-4a2a-aec6-9e93bdddf5cf tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:25.698892 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-d6e28966-aa67-4a2a-aec6-9e93bdddf5cf tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:25.710088 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-d6e28966-aa67-4a2a-aec6-9e93bdddf5cf tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:25.710088 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-d6e28966-aa67-4a2a-aec6-9e93bdddf5cf tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:25.710088 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d6e28966-aa67-4a2a-aec6-9e93bdddf5cf tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1743 microversion: 2.20 time: 0.178344 Feb 21 01:36:25.710374 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 297/612] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:25 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1743 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:26.151543 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a16abb54-a1ea-44f0-9aa2-339f123a8285 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:26.152157 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a16abb54-a1ea-44f0-9aa2-339f123a8285 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:26.158528 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a16abb54-a1ea-44f0-9aa2-339f123a8285 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:26.159343 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a16abb54-a1ea-44f0-9aa2-339f123a8285 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:26.159754 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a16abb54-a1ea-44f0-9aa2-339f123a8285 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:26.160376 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a16abb54-a1ea-44f0-9aa2-339f123a8285 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:26.308454 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-a16abb54-a1ea-44f0-9aa2-339f123a8285 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:26.317543 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a16abb54-a1ea-44f0-9aa2-339f123a8285 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1260 microversion: 2.1 time: 0.169015 Feb 21 01:36:26.318086 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 316/613] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:26 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:26.380398 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d3322fa7-f7d2-4ef4-aa3d-3f7c83848fc0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:26.381048 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d3322fa7-f7d2-4ef4-aa3d-3f7c83848fc0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:26.387483 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3322fa7-f7d2-4ef4-aa3d-3f7c83848fc0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:26.387927 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3322fa7-f7d2-4ef4-aa3d-3f7c83848fc0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:26.388714 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3322fa7-f7d2-4ef4-aa3d-3f7c83848fc0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:26.389140 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3322fa7-f7d2-4ef4-aa3d-3f7c83848fc0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:26.535793 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-d3322fa7-f7d2-4ef4-aa3d-3f7c83848fc0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:26.543526 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d3322fa7-f7d2-4ef4-aa3d-3f7c83848fc0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1699 microversion: 2.1 time: 0.167295 Feb 21 01:36:26.544262 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 298/614] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:26 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1699 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:26.560499 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f26ebab3-b095-4a7a-8d61-a486319e9db9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:36:26.566383 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f26ebab3-b095-4a7a-8d61-a486319e9db9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:26.566824 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f26ebab3-b095-4a7a-8d61-a486319e9db9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:26.588571 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f26ebab3-b095-4a7a-8d61-a486319e9db9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Going to try to start instance {{(pid=123541) start /opt/stack/nova/nova/compute/api.py:2677}} Feb 21 01:36:26.726839 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9d09520d-4de5-4a9c-a80c-8c598bfa10e1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:26.727669 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9d09520d-4de5-4a9c-a80c-8c598bfa10e1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:26.734397 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d09520d-4de5-4a9c-a80c-8c598bfa10e1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:26.735221 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d09520d-4de5-4a9c-a80c-8c598bfa10e1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:26.736502 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d09520d-4de5-4a9c-a80c-8c598bfa10e1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:26.737113 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9d09520d-4de5-4a9c-a80c-8c598bfa10e1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:26.768243 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f26ebab3-b095-4a7a-8d61-a486319e9db9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "POST /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd/action" status: 202 len: 0 microversion: 2.1 time: 0.211316 Feb 21 01:36:26.769073 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 317/615] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Feb 21 01:36:26 2022] POST /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 21 01:36:26.785209 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0fa96567-b848-475d-b1fa-a7e995789453 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:26.786459 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0fa96567-b848-475d-b1fa-a7e995789453 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:26.793132 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0fa96567-b848-475d-b1fa-a7e995789453 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:26.793778 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0fa96567-b848-475d-b1fa-a7e995789453 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:26.794801 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0fa96567-b848-475d-b1fa-a7e995789453 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:26.795457 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0fa96567-b848-475d-b1fa-a7e995789453 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:26.921935 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-9d09520d-4de5-4a9c-a80c-8c598bfa10e1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:26.931809 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-9d09520d-4de5-4a9c-a80c-8c598bfa10e1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:26.934235 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-9d09520d-4de5-4a9c-a80c-8c598bfa10e1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:26.936072 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9d09520d-4de5-4a9c-a80c-8c598bfa10e1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1743 microversion: 2.20 time: 0.212644 Feb 21 01:36:26.937196 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 299/616] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:26 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1743 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:27.017515 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-0fa96567-b848-475d-b1fa-a7e995789453 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:27.025405 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0fa96567-b848-475d-b1fa-a7e995789453 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1708 microversion: 2.1 time: 0.244892 Feb 21 01:36:27.029499 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 318/617] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:26 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1708 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:36:27.334672 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ec86ab9d-2580-44e2-a98e-b93dee268be9 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:27.335551 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ec86ab9d-2580-44e2-a98e-b93dee268be9 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:27.341636 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec86ab9d-2580-44e2-a98e-b93dee268be9 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:27.342193 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec86ab9d-2580-44e2-a98e-b93dee268be9 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:27.343213 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec86ab9d-2580-44e2-a98e-b93dee268be9 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:27.343769 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ec86ab9d-2580-44e2-a98e-b93dee268be9 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:27.610479 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ec86ab9d-2580-44e2-a98e-b93dee268be9 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:27.619922 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ec86ab9d-2580-44e2-a98e-b93dee268be9 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1260 microversion: 2.1 time: 0.289512 Feb 21 01:36:27.631737 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 300/618] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:27 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1260 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:27.957535 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-88b93ae1-7bc3-46fa-965d-8bff4d9ccc9a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:27.957535 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-88b93ae1-7bc3-46fa-965d-8bff4d9ccc9a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:27.962711 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-88b93ae1-7bc3-46fa-965d-8bff4d9ccc9a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:27.963358 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-88b93ae1-7bc3-46fa-965d-8bff4d9ccc9a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:27.964147 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-88b93ae1-7bc3-46fa-965d-8bff4d9ccc9a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:27.964622 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-88b93ae1-7bc3-46fa-965d-8bff4d9ccc9a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:28.043585 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f0992b72-fcd0-49f0-a5bf-c57a27d8f16f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:28.045413 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f0992b72-fcd0-49f0-a5bf-c57a27d8f16f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:28.052789 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0992b72-fcd0-49f0-a5bf-c57a27d8f16f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:28.053338 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0992b72-fcd0-49f0-a5bf-c57a27d8f16f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:28.054064 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0992b72-fcd0-49f0-a5bf-c57a27d8f16f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:28.054493 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0992b72-fcd0-49f0-a5bf-c57a27d8f16f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:28.150065 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-88b93ae1-7bc3-46fa-965d-8bff4d9ccc9a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:28.158904 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-88b93ae1-7bc3-46fa-965d-8bff4d9ccc9a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:28.160876 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-88b93ae1-7bc3-46fa-965d-8bff4d9ccc9a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:28.162350 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-88b93ae1-7bc3-46fa-965d-8bff4d9ccc9a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1743 microversion: 2.20 time: 0.212449 Feb 21 01:36:28.163160 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 319/619] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:27 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1743 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:36:28.222146 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-f0992b72-fcd0-49f0-a5bf-c57a27d8f16f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:28.229967 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f0992b72-fcd0-49f0-a5bf-c57a27d8f16f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1708 microversion: 2.1 time: 0.190335 Feb 21 01:36:28.230564 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 301/620] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:28 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1708 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:28.636751 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2102ba43-c2b2-48c7-bd61-19e01432e64c tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:28.637372 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2102ba43-c2b2-48c7-bd61-19e01432e64c tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:28.643073 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2102ba43-c2b2-48c7-bd61-19e01432e64c tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:28.643520 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2102ba43-c2b2-48c7-bd61-19e01432e64c tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:28.644291 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2102ba43-c2b2-48c7-bd61-19e01432e64c tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:28.644762 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2102ba43-c2b2-48c7-bd61-19e01432e64c tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:28.780885 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2102ba43-c2b2-48c7-bd61-19e01432e64c tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:28.788885 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2102ba43-c2b2-48c7-bd61-19e01432e64c tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1260 microversion: 2.1 time: 0.155956 Feb 21 01:36:28.789464 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 320/621] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:28 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:29.179965 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a6f5e5cf-51d1-46a6-a148-9e44ee2fef92 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:29.181041 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a6f5e5cf-51d1-46a6-a148-9e44ee2fef92 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:29.188623 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f5e5cf-51d1-46a6-a148-9e44ee2fef92 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:29.189921 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f5e5cf-51d1-46a6-a148-9e44ee2fef92 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:29.191267 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f5e5cf-51d1-46a6-a148-9e44ee2fef92 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:29.192374 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a6f5e5cf-51d1-46a6-a148-9e44ee2fef92 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:29.247312 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a342ba8c-f1bc-4497-8dbb-f6950cbc6b75 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:29.248234 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a342ba8c-f1bc-4497-8dbb-f6950cbc6b75 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:29.255824 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a342ba8c-f1bc-4497-8dbb-f6950cbc6b75 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:29.256545 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a342ba8c-f1bc-4497-8dbb-f6950cbc6b75 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:29.257638 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a342ba8c-f1bc-4497-8dbb-f6950cbc6b75 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:29.258429 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a342ba8c-f1bc-4497-8dbb-f6950cbc6b75 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:29.365956 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-a6f5e5cf-51d1-46a6-a148-9e44ee2fef92 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:29.373857 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-a6f5e5cf-51d1-46a6-a148-9e44ee2fef92 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:29.375363 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-a6f5e5cf-51d1-46a6-a148-9e44ee2fef92 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:29.376764 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a6f5e5cf-51d1-46a6-a148-9e44ee2fef92 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1743 microversion: 2.20 time: 0.200485 Feb 21 01:36:29.388921 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 302/622] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:29 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1743 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:29.430951 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-a342ba8c-f1bc-4497-8dbb-f6950cbc6b75 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:29.439416 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a342ba8c-f1bc-4497-8dbb-f6950cbc6b75 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1712 microversion: 2.1 time: 0.195807 Feb 21 01:36:29.439989 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 321/623] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:29 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1712 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:36:29.804992 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e58b6a61-b618-47ea-be99-aa675ca4c218 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:29.805604 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e58b6a61-b618-47ea-be99-aa675ca4c218 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:29.811271 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e58b6a61-b618-47ea-be99-aa675ca4c218 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:29.812505 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e58b6a61-b618-47ea-be99-aa675ca4c218 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:29.812505 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e58b6a61-b618-47ea-be99-aa675ca4c218 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:29.812992 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e58b6a61-b618-47ea-be99-aa675ca4c218 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:29.944332 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-e58b6a61-b618-47ea-be99-aa675ca4c218 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:29.951588 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e58b6a61-b618-47ea-be99-aa675ca4c218 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1260 microversion: 2.1 time: 0.150715 Feb 21 01:36:29.952147 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 303/624] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:29 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:30.304694 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-be474160-f877-4794-a6c4-a44e5889e752 req-7a07e5d4-9042-4507-afae-86daf1c4676d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "962b0526-5a3e-4044-a74f-34fe41f7717d", "name": "network-vif-plugged", "status": "completed", "tag": "d7edbb2e-2fa7-4065-ba3b-97a6d16d31e7"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:36:30.307238 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:36:30.307238 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:36:30.315465 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-be474160-f877-4794-a6c4-a44e5889e752 req-7a07e5d4-9042-4507-afae-86daf1c4676d service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:30.315626 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-be474160-f877-4794-a6c4-a44e5889e752 req-7a07e5d4-9042-4507-afae-86daf1c4676d service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:30.334687 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-be474160-f877-4794-a6c4-a44e5889e752 req-7a07e5d4-9042-4507-afae-86daf1c4676d service nova] Creating event network-vif-plugged:d7edbb2e-2fa7-4065-ba3b-97a6d16d31e7 for instance 962b0526-5a3e-4044-a74f-34fe41f7717d on hv-cinder-81322 Feb 21 01:36:30.334687 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-be474160-f877-4794-a6c4-a44e5889e752 req-7a07e5d4-9042-4507-afae-86daf1c4676d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031875 Feb 21 01:36:30.334687 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 322/625] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:36:30.397249 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-19b3c552-3aaa-4779-9775-a41777d749e0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:30.398114 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-19b3c552-3aaa-4779-9775-a41777d749e0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:30.407334 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19b3c552-3aaa-4779-9775-a41777d749e0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:30.407847 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19b3c552-3aaa-4779-9775-a41777d749e0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:30.408734 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19b3c552-3aaa-4779-9775-a41777d749e0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:30.409338 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-19b3c552-3aaa-4779-9775-a41777d749e0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:30.553516 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-19b3c552-3aaa-4779-9775-a41777d749e0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:30.561488 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-19b3c552-3aaa-4779-9775-a41777d749e0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:30.563015 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-19b3c552-3aaa-4779-9775-a41777d749e0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:30.564156 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-19b3c552-3aaa-4779-9775-a41777d749e0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1743 microversion: 2.20 time: 0.172752 Feb 21 01:36:30.564755 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 304/626] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:30 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1743 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:30.968377 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-db8d04c2-d8e7-4549-aef7-4b070a756c92 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:30.969088 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-db8d04c2-d8e7-4549-aef7-4b070a756c92 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:30.976266 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db8d04c2-d8e7-4549-aef7-4b070a756c92 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:30.982047 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db8d04c2-d8e7-4549-aef7-4b070a756c92 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:30.982047 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db8d04c2-d8e7-4549-aef7-4b070a756c92 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:30.982047 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db8d04c2-d8e7-4549-aef7-4b070a756c92 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:31.123579 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-db8d04c2-d8e7-4549-aef7-4b070a756c92 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:31.140469 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-db8d04c2-d8e7-4549-aef7-4b070a756c92 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1260 microversion: 2.1 time: 0.175916 Feb 21 01:36:31.141079 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 323/627] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:30 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:36:31.582202 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a902161a-a45f-4d2b-b789-b2c974ef987d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:31.582804 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a902161a-a45f-4d2b-b789-b2c974ef987d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:31.589028 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a902161a-a45f-4d2b-b789-b2c974ef987d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:31.589500 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a902161a-a45f-4d2b-b789-b2c974ef987d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:31.590263 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a902161a-a45f-4d2b-b789-b2c974ef987d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:31.590692 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a902161a-a45f-4d2b-b789-b2c974ef987d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:31.722721 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-a902161a-a45f-4d2b-b789-b2c974ef987d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:31.730973 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-a902161a-a45f-4d2b-b789-b2c974ef987d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:31.732500 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-a902161a-a45f-4d2b-b789-b2c974ef987d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:31.733640 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a902161a-a45f-4d2b-b789-b2c974ef987d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1743 microversion: 2.20 time: 0.155182 Feb 21 01:36:31.734220 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 305/628] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:31 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:32.156513 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4b025b43-8abc-4f4a-a4eb-4d877127f66b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:32.157111 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4b025b43-8abc-4f4a-a4eb-4d877127f66b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:32.163189 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b025b43-8abc-4f4a-a4eb-4d877127f66b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:32.163637 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b025b43-8abc-4f4a-a4eb-4d877127f66b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:32.164412 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b025b43-8abc-4f4a-a4eb-4d877127f66b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:32.164870 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4b025b43-8abc-4f4a-a4eb-4d877127f66b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:32.293420 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-4b025b43-8abc-4f4a-a4eb-4d877127f66b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:32.300536 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4b025b43-8abc-4f4a-a4eb-4d877127f66b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1260 microversion: 2.1 time: 0.147799 Feb 21 01:36:32.301096 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 324/629] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:32 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:32.752458 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bce4f174-6f13-4b74-a7e7-d74b55daa389 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:32.753040 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bce4f174-6f13-4b74-a7e7-d74b55daa389 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:32.760096 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bce4f174-6f13-4b74-a7e7-d74b55daa389 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:32.760618 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bce4f174-6f13-4b74-a7e7-d74b55daa389 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:32.761387 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bce4f174-6f13-4b74-a7e7-d74b55daa389 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:32.761814 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bce4f174-6f13-4b74-a7e7-d74b55daa389 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:32.899366 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-bce4f174-6f13-4b74-a7e7-d74b55daa389 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:32.922963 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-bce4f174-6f13-4b74-a7e7-d74b55daa389 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:32.925341 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-bce4f174-6f13-4b74-a7e7-d74b55daa389 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:32.927904 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bce4f174-6f13-4b74-a7e7-d74b55daa389 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1738 microversion: 2.20 time: 0.178095 Feb 21 01:36:32.928813 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 306/630] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:32 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:33.316901 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3776a0c4-8797-4846-8101-04ee9b7b5717 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:33.317873 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3776a0c4-8797-4846-8101-04ee9b7b5717 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:33.326930 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3776a0c4-8797-4846-8101-04ee9b7b5717 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:33.329937 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3776a0c4-8797-4846-8101-04ee9b7b5717 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:33.330968 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3776a0c4-8797-4846-8101-04ee9b7b5717 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:33.331456 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3776a0c4-8797-4846-8101-04ee9b7b5717 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:33.487104 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-3776a0c4-8797-4846-8101-04ee9b7b5717 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:33.495037 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3776a0c4-8797-4846-8101-04ee9b7b5717 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1260 microversion: 2.1 time: 0.182125 Feb 21 01:36:33.504917 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 325/631] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:33 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:33.954494 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7e6bc99b-1336-43a1-b7ee-64b8b946201f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:33.955793 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7e6bc99b-1336-43a1-b7ee-64b8b946201f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:33.963832 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e6bc99b-1336-43a1-b7ee-64b8b946201f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:33.964557 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e6bc99b-1336-43a1-b7ee-64b8b946201f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:33.965587 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e6bc99b-1336-43a1-b7ee-64b8b946201f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:33.966239 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e6bc99b-1336-43a1-b7ee-64b8b946201f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:34.183351 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-7e6bc99b-1336-43a1-b7ee-64b8b946201f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:34.194431 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-7e6bc99b-1336-43a1-b7ee-64b8b946201f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:34.196301 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-7e6bc99b-1336-43a1-b7ee-64b8b946201f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:34.198169 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7e6bc99b-1336-43a1-b7ee-64b8b946201f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1738 microversion: 2.20 time: 0.247756 Feb 21 01:36:34.208590 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 307/632] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:33 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1738 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:34.344499 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-b1cca584-508d-4b40-a45d-449d2e9a64ff req-84d7add9-5f43-47f6-9748-8530949bf770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bfdab9d-ba0f-4923-ad4e-40ef23db9338", "name": "network-vif-plugged", "status": "completed", "tag": "682a620b-646c-4dfa-8198-bae01e8d1e36"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:36:34.347537 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:36:34.347537 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:36:34.362428 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b1cca584-508d-4b40-a45d-449d2e9a64ff req-84d7add9-5f43-47f6-9748-8530949bf770 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:34.365057 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b1cca584-508d-4b40-a45d-449d2e9a64ff req-84d7add9-5f43-47f6-9748-8530949bf770 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:34.378249 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-b1cca584-508d-4b40-a45d-449d2e9a64ff req-84d7add9-5f43-47f6-9748-8530949bf770 service nova] Creating event network-vif-plugged:682a620b-646c-4dfa-8198-bae01e8d1e36 for instance 3bfdab9d-ba0f-4923-ad4e-40ef23db9338 on hv-cinder-81322 Feb 21 01:36:34.384456 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-b1cca584-508d-4b40-a45d-449d2e9a64ff req-84d7add9-5f43-47f6-9748-8530949bf770 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045526 Feb 21 01:36:34.385820 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 326/633] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:36:34.514608 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-40e4c506-d034-407a-b7b9-aeff7c6ad233 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:34.517088 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-40e4c506-d034-407a-b7b9-aeff7c6ad233 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:34.525261 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40e4c506-d034-407a-b7b9-aeff7c6ad233 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:34.525985 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40e4c506-d034-407a-b7b9-aeff7c6ad233 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:34.526946 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40e4c506-d034-407a-b7b9-aeff7c6ad233 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:34.527478 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-40e4c506-d034-407a-b7b9-aeff7c6ad233 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:34.719521 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-40e4c506-d034-407a-b7b9-aeff7c6ad233 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:34.730404 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-40e4c506-d034-407a-b7b9-aeff7c6ad233 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1260 microversion: 2.1 time: 0.222702 Feb 21 01:36:34.742054 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 308/634] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:34 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1260 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:35.216962 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2e92a052-dbff-43da-bf95-49d0dc31b200 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:35.218142 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2e92a052-dbff-43da-bf95-49d0dc31b200 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:35.225408 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e92a052-dbff-43da-bf95-49d0dc31b200 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:35.226143 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e92a052-dbff-43da-bf95-49d0dc31b200 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:35.227358 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e92a052-dbff-43da-bf95-49d0dc31b200 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:35.229001 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e92a052-dbff-43da-bf95-49d0dc31b200 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:35.392448 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2e92a052-dbff-43da-bf95-49d0dc31b200 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:35.404863 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2e92a052-dbff-43da-bf95-49d0dc31b200 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:35.405934 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2e92a052-dbff-43da-bf95-49d0dc31b200 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:35.408748 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2e92a052-dbff-43da-bf95-49d0dc31b200 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1738 microversion: 2.20 time: 0.194914 Feb 21 01:36:35.420558 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 327/635] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:35 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:35.749502 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5a6a8bba-7453-4c17-8c36-64f0e3e9012c tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:35.750787 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5a6a8bba-7453-4c17-8c36-64f0e3e9012c tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:35.757708 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a6a8bba-7453-4c17-8c36-64f0e3e9012c tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:35.758365 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a6a8bba-7453-4c17-8c36-64f0e3e9012c tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:35.759794 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a6a8bba-7453-4c17-8c36-64f0e3e9012c tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:35.760234 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a6a8bba-7453-4c17-8c36-64f0e3e9012c tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:35.913030 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-5a6a8bba-7453-4c17-8c36-64f0e3e9012c tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:35.920832 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5a6a8bba-7453-4c17-8c36-64f0e3e9012c tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1260 microversion: 2.1 time: 0.175263 Feb 21 01:36:35.922702 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 309/636] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:35 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:36.428829 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-30db6c68-fd4a-44d9-a0bf-f390318b5267 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:36.429484 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-30db6c68-fd4a-44d9-a0bf-f390318b5267 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:36.435945 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30db6c68-fd4a-44d9-a0bf-f390318b5267 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:36.436398 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30db6c68-fd4a-44d9-a0bf-f390318b5267 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:36.437191 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30db6c68-fd4a-44d9-a0bf-f390318b5267 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:36.437620 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-30db6c68-fd4a-44d9-a0bf-f390318b5267 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:36.571203 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-30db6c68-fd4a-44d9-a0bf-f390318b5267 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:36.583518 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-30db6c68-fd4a-44d9-a0bf-f390318b5267 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:36.585107 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-30db6c68-fd4a-44d9-a0bf-f390318b5267 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:36.586271 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-30db6c68-fd4a-44d9-a0bf-f390318b5267 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1738 microversion: 2.20 time: 0.161461 Feb 21 01:36:36.586833 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 328/637] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:36 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:36.938904 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c27182c9-a50b-403e-a184-5730f98ca854 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:36.939658 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c27182c9-a50b-403e-a184-5730f98ca854 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:36.950507 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c27182c9-a50b-403e-a184-5730f98ca854 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:36.950989 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c27182c9-a50b-403e-a184-5730f98ca854 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:36.951775 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c27182c9-a50b-403e-a184-5730f98ca854 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:36.952205 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c27182c9-a50b-403e-a184-5730f98ca854 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:37.119275 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c27182c9-a50b-403e-a184-5730f98ca854 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:37.127061 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c27182c9-a50b-403e-a184-5730f98ca854 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1444 microversion: 2.1 time: 0.192025 Feb 21 01:36:37.127628 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 310/638] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:36 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1444 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:37.150148 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b0e31be2-ed22-4bed-8e2d-7339f6ccd257 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:37.151822 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b0e31be2-ed22-4bed-8e2d-7339f6ccd257 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:37.160801 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b0e31be2-ed22-4bed-8e2d-7339f6ccd257 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:37.161334 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b0e31be2-ed22-4bed-8e2d-7339f6ccd257 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:37.162615 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b0e31be2-ed22-4bed-8e2d-7339f6ccd257 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:37.163121 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b0e31be2-ed22-4bed-8e2d-7339f6ccd257 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:37.336937 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b0e31be2-ed22-4bed-8e2d-7339f6ccd257 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:37.345909 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b0e31be2-ed22-4bed-8e2d-7339f6ccd257 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1444 microversion: 2.1 time: 0.201269 Feb 21 01:36:37.347152 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 329/639] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:36:37 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1444 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:36:37.606562 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-768850e5-52ac-4a83-83e6-6e7e54952886 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:37.607903 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-768850e5-52ac-4a83-83e6-6e7e54952886 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:37.624722 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-768850e5-52ac-4a83-83e6-6e7e54952886 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:37.625617 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-768850e5-52ac-4a83-83e6-6e7e54952886 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:37.626519 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-768850e5-52ac-4a83-83e6-6e7e54952886 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:37.627015 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-768850e5-52ac-4a83-83e6-6e7e54952886 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:37.850322 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-768850e5-52ac-4a83-83e6-6e7e54952886 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:37.858492 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-768850e5-52ac-4a83-83e6-6e7e54952886 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:37.859919 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-768850e5-52ac-4a83-83e6-6e7e54952886 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:37.862521 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-768850e5-52ac-4a83-83e6-6e7e54952886 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1738 microversion: 2.20 time: 0.261839 Feb 21 01:36:37.864147 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 311/640] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:37 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1738 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:38.881901 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a0df1314-5f47-4ee1-b324-0ff8c97d001e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:38.883128 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a0df1314-5f47-4ee1-b324-0ff8c97d001e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:38.895978 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a0df1314-5f47-4ee1-b324-0ff8c97d001e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:38.896449 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a0df1314-5f47-4ee1-b324-0ff8c97d001e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:38.897274 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a0df1314-5f47-4ee1-b324-0ff8c97d001e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:38.897711 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a0df1314-5f47-4ee1-b324-0ff8c97d001e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:39.177392 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-a0df1314-5f47-4ee1-b324-0ff8c97d001e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:39.185915 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-a0df1314-5f47-4ee1-b324-0ff8c97d001e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:39.187418 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-a0df1314-5f47-4ee1-b324-0ff8c97d001e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:39.200685 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a0df1314-5f47-4ee1-b324-0ff8c97d001e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1738 microversion: 2.20 time: 0.323000 Feb 21 01:36:39.201831 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 330/641] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:38 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1738 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:40.220280 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f9d58723-328e-4131-bbe9-f693995d2d52 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:40.221687 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f9d58723-328e-4131-bbe9-f693995d2d52 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:40.228255 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9d58723-328e-4131-bbe9-f693995d2d52 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:40.228810 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9d58723-328e-4131-bbe9-f693995d2d52 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:40.229602 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9d58723-328e-4131-bbe9-f693995d2d52 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:40.230041 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9d58723-328e-4131-bbe9-f693995d2d52 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:40.381613 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-f9d58723-328e-4131-bbe9-f693995d2d52 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:40.389771 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-f9d58723-328e-4131-bbe9-f693995d2d52 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:40.391314 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-f9d58723-328e-4131-bbe9-f693995d2d52 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:40.392628 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f9d58723-328e-4131-bbe9-f693995d2d52 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1738 microversion: 2.20 time: 0.178349 Feb 21 01:36:40.393509 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 312/642] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:40 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:40.468038 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-a6d3818d-1206-4200-92fe-d08712571450 req-411f5a1a-231a-4617-8244-75c636f78a36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bfdab9d-ba0f-4923-ad4e-40ef23db9338", "tag": "682a620b-646c-4dfa-8198-bae01e8d1e36"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:36:40.469558 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:36:40.469558 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:36:40.477379 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a6d3818d-1206-4200-92fe-d08712571450 req-411f5a1a-231a-4617-8244-75c636f78a36 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:40.478052 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-a6d3818d-1206-4200-92fe-d08712571450 req-411f5a1a-231a-4617-8244-75c636f78a36 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:40.495315 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-a6d3818d-1206-4200-92fe-d08712571450 req-411f5a1a-231a-4617-8244-75c636f78a36 service nova] Creating event network-changed:682a620b-646c-4dfa-8198-bae01e8d1e36 for instance 3bfdab9d-ba0f-4923-ad4e-40ef23db9338 on hv-cinder-81322 Feb 21 01:36:40.498071 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-a6d3818d-1206-4200-92fe-d08712571450 req-411f5a1a-231a-4617-8244-75c636f78a36 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033542 Feb 21 01:36:40.498856 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 331/643] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:36:41.413852 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-092a5e26-3ca1-4231-be0d-e07148f82a90 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:41.414477 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-092a5e26-3ca1-4231-be0d-e07148f82a90 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:41.426724 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-092a5e26-3ca1-4231-be0d-e07148f82a90 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:41.427408 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-092a5e26-3ca1-4231-be0d-e07148f82a90 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:41.428730 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-092a5e26-3ca1-4231-be0d-e07148f82a90 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:41.429438 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-092a5e26-3ca1-4231-be0d-e07148f82a90 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:41.688537 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-092a5e26-3ca1-4231-be0d-e07148f82a90 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:41.699052 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-092a5e26-3ca1-4231-be0d-e07148f82a90 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:41.703644 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-092a5e26-3ca1-4231-be0d-e07148f82a90 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:41.707569 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-092a5e26-3ca1-4231-be0d-e07148f82a90 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1738 microversion: 2.20 time: 0.298235 Feb 21 01:36:41.708221 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 313/644] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:41 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1738 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:42.726906 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4751050a-f3eb-48da-9512-6d7be21f1f14 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:42.728329 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4751050a-f3eb-48da-9512-6d7be21f1f14 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:42.735608 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4751050a-f3eb-48da-9512-6d7be21f1f14 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:42.736321 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4751050a-f3eb-48da-9512-6d7be21f1f14 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:42.737314 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4751050a-f3eb-48da-9512-6d7be21f1f14 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:42.737754 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4751050a-f3eb-48da-9512-6d7be21f1f14 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:42.912527 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-4751050a-f3eb-48da-9512-6d7be21f1f14 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:42.921140 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-4751050a-f3eb-48da-9512-6d7be21f1f14 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:42.923003 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-4751050a-f3eb-48da-9512-6d7be21f1f14 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:42.924261 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4751050a-f3eb-48da-9512-6d7be21f1f14 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1738 microversion: 2.20 time: 0.202196 Feb 21 01:36:42.924928 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 332/645] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:42 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:43.942941 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c38e4b51-0965-4d1f-82fb-586bd76ac273 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:43.943576 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c38e4b51-0965-4d1f-82fb-586bd76ac273 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:43.949816 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c38e4b51-0965-4d1f-82fb-586bd76ac273 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:43.950262 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c38e4b51-0965-4d1f-82fb-586bd76ac273 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:43.951037 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c38e4b51-0965-4d1f-82fb-586bd76ac273 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:43.951476 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c38e4b51-0965-4d1f-82fb-586bd76ac273 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:44.083733 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c38e4b51-0965-4d1f-82fb-586bd76ac273 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:44.091356 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c38e4b51-0965-4d1f-82fb-586bd76ac273 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:44.092871 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c38e4b51-0965-4d1f-82fb-586bd76ac273 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:44.094045 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c38e4b51-0965-4d1f-82fb-586bd76ac273 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1738 microversion: 2.20 time: 0.154855 Feb 21 01:36:44.094606 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 314/646] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:43 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:45.112787 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b9ed61fd-b28c-496a-8a9b-e6a993073eac tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:45.114222 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b9ed61fd-b28c-496a-8a9b-e6a993073eac tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:45.120455 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9ed61fd-b28c-496a-8a9b-e6a993073eac tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:45.120920 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9ed61fd-b28c-496a-8a9b-e6a993073eac tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:45.121700 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9ed61fd-b28c-496a-8a9b-e6a993073eac tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:45.122136 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9ed61fd-b28c-496a-8a9b-e6a993073eac tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:45.271755 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b9ed61fd-b28c-496a-8a9b-e6a993073eac tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:45.279386 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b9ed61fd-b28c-496a-8a9b-e6a993073eac tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:45.280908 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b9ed61fd-b28c-496a-8a9b-e6a993073eac tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:45.284523 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b9ed61fd-b28c-496a-8a9b-e6a993073eac tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1738 microversion: 2.20 time: 0.172973 Feb 21 01:36:45.284523 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 333/647] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:45 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:46.301287 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d3bc5177-9e50-43f8-8bc7-3c54d68278ae tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:46.307989 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d3bc5177-9e50-43f8-8bc7-3c54d68278ae tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:46.310958 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3bc5177-9e50-43f8-8bc7-3c54d68278ae tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:46.311623 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3bc5177-9e50-43f8-8bc7-3c54d68278ae tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:46.312645 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3bc5177-9e50-43f8-8bc7-3c54d68278ae tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:46.313073 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d3bc5177-9e50-43f8-8bc7-3c54d68278ae tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:46.467307 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-d3bc5177-9e50-43f8-8bc7-3c54d68278ae tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:46.475068 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-d3bc5177-9e50-43f8-8bc7-3c54d68278ae tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:46.476608 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-d3bc5177-9e50-43f8-8bc7-3c54d68278ae tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:46.477758 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d3bc5177-9e50-43f8-8bc7-3c54d68278ae tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1738 microversion: 2.20 time: 0.180264 Feb 21 01:36:46.478317 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 315/648] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:46 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:47.496114 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4dc9d853-763e-463f-8b0b-721f96101086 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:47.496786 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4dc9d853-763e-463f-8b0b-721f96101086 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:47.503175 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4dc9d853-763e-463f-8b0b-721f96101086 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:47.503805 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4dc9d853-763e-463f-8b0b-721f96101086 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:47.504661 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4dc9d853-763e-463f-8b0b-721f96101086 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:47.505105 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4dc9d853-763e-463f-8b0b-721f96101086 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:47.639624 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-4dc9d853-763e-463f-8b0b-721f96101086 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:47.648521 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-4dc9d853-763e-463f-8b0b-721f96101086 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:47.650005 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-4dc9d853-763e-463f-8b0b-721f96101086 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:47.651191 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4dc9d853-763e-463f-8b0b-721f96101086 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1720 microversion: 2.20 time: 0.158988 Feb 21 01:36:47.651740 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 334/649] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:47 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:48.669332 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-18f5e2fa-ce94-4f18-89c3-d5cb06663605 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:48.670596 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-18f5e2fa-ce94-4f18-89c3-d5cb06663605 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:48.677706 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18f5e2fa-ce94-4f18-89c3-d5cb06663605 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:48.678442 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18f5e2fa-ce94-4f18-89c3-d5cb06663605 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:48.679239 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18f5e2fa-ce94-4f18-89c3-d5cb06663605 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:48.679670 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-18f5e2fa-ce94-4f18-89c3-d5cb06663605 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:48.822588 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-18f5e2fa-ce94-4f18-89c3-d5cb06663605 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:48.830566 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-18f5e2fa-ce94-4f18-89c3-d5cb06663605 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:48.832207 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-18f5e2fa-ce94-4f18-89c3-d5cb06663605 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:48.834021 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-18f5e2fa-ce94-4f18-89c3-d5cb06663605 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1720 microversion: 2.20 time: 0.168406 Feb 21 01:36:48.845041 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 316/650] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:48 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:49.852810 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2f32eaf2-fca7-4827-bfc0-ee43b20b0970 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:49.853419 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2f32eaf2-fca7-4827-bfc0-ee43b20b0970 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:49.860030 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f32eaf2-fca7-4827-bfc0-ee43b20b0970 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:49.860508 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f32eaf2-fca7-4827-bfc0-ee43b20b0970 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:49.861295 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f32eaf2-fca7-4827-bfc0-ee43b20b0970 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:49.861731 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f32eaf2-fca7-4827-bfc0-ee43b20b0970 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:49.995356 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2f32eaf2-fca7-4827-bfc0-ee43b20b0970 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:50.002999 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2f32eaf2-fca7-4827-bfc0-ee43b20b0970 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:50.004532 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2f32eaf2-fca7-4827-bfc0-ee43b20b0970 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:50.005679 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2f32eaf2-fca7-4827-bfc0-ee43b20b0970 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1663 microversion: 2.20 time: 0.156490 Feb 21 01:36:50.006236 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 335/651] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:49 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:50.023832 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e86c1f40-ebbc-41a0-b96c-724e4e4287ce tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05901c1a-86bf-4865-ac93-8c23d63a7a2c"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:36:50.025122 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e86c1f40-ebbc-41a0-b96c-724e4e4287ce tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:50.031835 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e86c1f40-ebbc-41a0-b96c-724e4e4287ce tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:50.032275 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e86c1f40-ebbc-41a0-b96c-724e4e4287ce tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:50.033076 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e86c1f40-ebbc-41a0-b96c-724e4e4287ce tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:50.033500 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e86c1f40-ebbc-41a0-b96c-724e4e4287ce tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:50.231984 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-6aab2dba-9059-479e-95dd-91d435a2109a req-abc264a8-c0a4-4419-80d4-17a9b1381f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "962b0526-5a3e-4044-a74f-34fe41f7717d", "name": "network-vif-unplugged", "status": "completed", "tag": "d7edbb2e-2fa7-4065-ba3b-97a6d16d31e7"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:36:50.233594 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:36:50.233594 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:36:50.241350 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6aab2dba-9059-479e-95dd-91d435a2109a req-abc264a8-c0a4-4419-80d4-17a9b1381f25 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:50.241794 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-6aab2dba-9059-479e-95dd-91d435a2109a req-abc264a8-c0a4-4419-80d4-17a9b1381f25 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:50.252322 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.compute.server_external_events [req-6aab2dba-9059-479e-95dd-91d435a2109a req-abc264a8-c0a4-4419-80d4-17a9b1381f25 service nova] Unable to find a host for instance 962b0526-5a3e-4044-a74f-34fe41f7717d. Dropping event network-vif-unplugged {{(pid=123541) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 21 01:36:50.253239 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-6aab2dba-9059-479e-95dd-91d435a2109a req-abc264a8-c0a4-4419-80d4-17a9b1381f25 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025149 Feb 21 01:36:50.253776 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 336/652] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Feb 21 01:36:50.917967 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e86c1f40-ebbc-41a0-b96c-724e4e4287ce tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "POST /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.898405 Feb 21 01:36:50.918601 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 317/653] 10.222.0.90 () {62 vars in 1363 bytes} [Mon Feb 21 01:36:50 2022] POST /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d/os-volume_attachments => generated 188 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 21 01:36:51.034708 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d8053565-483b-4adf-a4ab-2642b9bb9f1c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:36:51.040190 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d8053565-483b-4adf-a4ab-2642b9bb9f1c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:51.044855 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8053565-483b-4adf-a4ab-2642b9bb9f1c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:51.045310 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8053565-483b-4adf-a4ab-2642b9bb9f1c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:51.046111 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8053565-483b-4adf-a4ab-2642b9bb9f1c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:51.046710 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d8053565-483b-4adf-a4ab-2642b9bb9f1c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:51.299865 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d8053565-483b-4adf-a4ab-2642b9bb9f1c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "POST /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d/action" status: 202 len: 0 microversion: 2.20 time: 0.269176 Feb 21 01:36:51.301217 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 337/654] 10.222.0.90 () {62 vars in 1318 bytes} [Mon Feb 21 01:36:51 2022] POST /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:36:51.308413 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-97ca4531-f20a-44d4-99c1-3afbe6934057 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:51.309048 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-97ca4531-f20a-44d4-99c1-3afbe6934057 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:51.315975 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97ca4531-f20a-44d4-99c1-3afbe6934057 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:51.316515 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97ca4531-f20a-44d4-99c1-3afbe6934057 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:51.317510 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97ca4531-f20a-44d4-99c1-3afbe6934057 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:51.317949 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97ca4531-f20a-44d4-99c1-3afbe6934057 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:51.476002 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-97ca4531-f20a-44d4-99c1-3afbe6934057 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:51.485446 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-97ca4531-f20a-44d4-99c1-3afbe6934057 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:51.487146 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-97ca4531-f20a-44d4-99c1-3afbe6934057 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:51.488399 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-97ca4531-f20a-44d4-99c1-3afbe6934057 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1749 microversion: 2.20 time: 0.183805 Feb 21 01:36:51.489127 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 318/655] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:51 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1749 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:52.507449 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0a99e6cb-34a8-4fab-9ab4-66715e4f0ab3 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:52.508204 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0a99e6cb-34a8-4fab-9ab4-66715e4f0ab3 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:52.514557 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a99e6cb-34a8-4fab-9ab4-66715e4f0ab3 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:52.515121 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a99e6cb-34a8-4fab-9ab4-66715e4f0ab3 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:52.515904 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a99e6cb-34a8-4fab-9ab4-66715e4f0ab3 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:52.516349 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0a99e6cb-34a8-4fab-9ab4-66715e4f0ab3 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:52.656512 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-0a99e6cb-34a8-4fab-9ab4-66715e4f0ab3 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:52.666264 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-0a99e6cb-34a8-4fab-9ab4-66715e4f0ab3 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:52.667891 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-0a99e6cb-34a8-4fab-9ab4-66715e4f0ab3 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:52.669333 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0a99e6cb-34a8-4fab-9ab4-66715e4f0ab3 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1749 microversion: 2.20 time: 0.166130 Feb 21 01:36:52.670117 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 338/656] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:52 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1749 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:53.690013 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7219012a-a6c8-45f4-b2cd-35ceaee88e01 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:53.691426 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7219012a-a6c8-45f4-b2cd-35ceaee88e01 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:53.699230 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7219012a-a6c8-45f4-b2cd-35ceaee88e01 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:53.700048 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7219012a-a6c8-45f4-b2cd-35ceaee88e01 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:53.701114 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7219012a-a6c8-45f4-b2cd-35ceaee88e01 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:53.701802 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7219012a-a6c8-45f4-b2cd-35ceaee88e01 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:53.868505 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-7219012a-a6c8-45f4-b2cd-35ceaee88e01 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:53.877089 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-7219012a-a6c8-45f4-b2cd-35ceaee88e01 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:53.879965 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-7219012a-a6c8-45f4-b2cd-35ceaee88e01 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:53.882095 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7219012a-a6c8-45f4-b2cd-35ceaee88e01 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1751 microversion: 2.20 time: 0.196463 Feb 21 01:36:53.882992 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 319/657] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:53 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1751 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:54.900574 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e59597a0-59d3-487b-bf02-07e8f3bd7aee tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:54.901182 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e59597a0-59d3-487b-bf02-07e8f3bd7aee tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:54.907772 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e59597a0-59d3-487b-bf02-07e8f3bd7aee tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:54.908217 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e59597a0-59d3-487b-bf02-07e8f3bd7aee tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:54.909026 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e59597a0-59d3-487b-bf02-07e8f3bd7aee tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:54.909459 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e59597a0-59d3-487b-bf02-07e8f3bd7aee tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:55.044532 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-e59597a0-59d3-487b-bf02-07e8f3bd7aee tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:55.058107 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-e59597a0-59d3-487b-bf02-07e8f3bd7aee tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:55.059924 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-e59597a0-59d3-487b-bf02-07e8f3bd7aee tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:55.061694 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e59597a0-59d3-487b-bf02-07e8f3bd7aee tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1751 microversion: 2.20 time: 0.164757 Feb 21 01:36:55.062699 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 339/658] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:54 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:56.080566 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4486f846-ad6f-4d4f-ba41-ed05a0241eed tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:56.081179 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4486f846-ad6f-4d4f-ba41-ed05a0241eed tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:56.087894 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4486f846-ad6f-4d4f-ba41-ed05a0241eed tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:56.088342 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4486f846-ad6f-4d4f-ba41-ed05a0241eed tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:56.089217 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4486f846-ad6f-4d4f-ba41-ed05a0241eed tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:56.089605 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4486f846-ad6f-4d4f-ba41-ed05a0241eed tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:56.521958 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-4486f846-ad6f-4d4f-ba41-ed05a0241eed tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:56.530110 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-4486f846-ad6f-4d4f-ba41-ed05a0241eed tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:56.531604 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-4486f846-ad6f-4d4f-ba41-ed05a0241eed tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:56.532815 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4486f846-ad6f-4d4f-ba41-ed05a0241eed tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.456041 Feb 21 01:36:56.533397 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 320/659] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:56 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:36:57.550893 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a18448ed-a1ca-48a9-bddc-a1feea164f1a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:57.551629 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a18448ed-a1ca-48a9-bddc-a1feea164f1a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:57.560531 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a18448ed-a1ca-48a9-bddc-a1feea164f1a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:57.560981 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a18448ed-a1ca-48a9-bddc-a1feea164f1a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:57.562007 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a18448ed-a1ca-48a9-bddc-a1feea164f1a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:57.562262 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a18448ed-a1ca-48a9-bddc-a1feea164f1a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:57.723517 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-a18448ed-a1ca-48a9-bddc-a1feea164f1a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:57.731673 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-a18448ed-a1ca-48a9-bddc-a1feea164f1a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:57.733270 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-a18448ed-a1ca-48a9-bddc-a1feea164f1a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:57.734407 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a18448ed-a1ca-48a9-bddc-a1feea164f1a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.187212 Feb 21 01:36:57.734955 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 340/660] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:57 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:36:58.752162 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-93ae2a3d-2c0d-4814-b22a-510d461be7f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:58.752735 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-93ae2a3d-2c0d-4814-b22a-510d461be7f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:58.759392 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93ae2a3d-2c0d-4814-b22a-510d461be7f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:58.759857 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93ae2a3d-2c0d-4814-b22a-510d461be7f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:58.760719 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93ae2a3d-2c0d-4814-b22a-510d461be7f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:58.761161 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-93ae2a3d-2c0d-4814-b22a-510d461be7f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:58.901916 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-93ae2a3d-2c0d-4814-b22a-510d461be7f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:58.910069 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-93ae2a3d-2c0d-4814-b22a-510d461be7f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:58.911588 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-93ae2a3d-2c0d-4814-b22a-510d461be7f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:36:58.913356 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-93ae2a3d-2c0d-4814-b22a-510d461be7f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.165073 Feb 21 01:36:58.913912 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 321/661] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:58 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:36:59.931679 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f7cf14eb-9711-4531-96c0-0164a3a4de6e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:36:59.932253 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f7cf14eb-9711-4531-96c0-0164a3a4de6e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:36:59.938634 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7cf14eb-9711-4531-96c0-0164a3a4de6e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:59.939077 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7cf14eb-9711-4531-96c0-0164a3a4de6e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:36:59.939849 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7cf14eb-9711-4531-96c0-0164a3a4de6e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:36:59.940274 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f7cf14eb-9711-4531-96c0-0164a3a4de6e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:00.232943 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-f7cf14eb-9711-4531-96c0-0164a3a4de6e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:00.241151 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-f7cf14eb-9711-4531-96c0-0164a3a4de6e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:00.242680 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-f7cf14eb-9711-4531-96c0-0164a3a4de6e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:00.243822 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f7cf14eb-9711-4531-96c0-0164a3a4de6e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.316594 Feb 21 01:37:00.244384 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 341/662] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:36:59 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:01.264091 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-224b9128-702f-4256-941c-14305a554fcc tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:01.264755 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-224b9128-702f-4256-941c-14305a554fcc tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:01.271178 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-224b9128-702f-4256-941c-14305a554fcc tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:01.271848 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-224b9128-702f-4256-941c-14305a554fcc tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:01.273169 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-224b9128-702f-4256-941c-14305a554fcc tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:01.273670 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-224b9128-702f-4256-941c-14305a554fcc tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:01.566311 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-224b9128-702f-4256-941c-14305a554fcc tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:01.579520 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-224b9128-702f-4256-941c-14305a554fcc tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:01.581335 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-224b9128-702f-4256-941c-14305a554fcc tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:01.582598 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-224b9128-702f-4256-941c-14305a554fcc tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.323380 Feb 21 01:37:01.583656 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 322/663] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:01 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:02.601261 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e0074052-4c8e-4027-a3a6-5749b52457bf tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:02.604317 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e0074052-4c8e-4027-a3a6-5749b52457bf tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:02.617583 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0074052-4c8e-4027-a3a6-5749b52457bf tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:02.617583 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0074052-4c8e-4027-a3a6-5749b52457bf tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:02.617583 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0074052-4c8e-4027-a3a6-5749b52457bf tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:02.617583 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e0074052-4c8e-4027-a3a6-5749b52457bf tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:02.765282 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-e0074052-4c8e-4027-a3a6-5749b52457bf tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:02.774167 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-e0074052-4c8e-4027-a3a6-5749b52457bf tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:02.775947 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-e0074052-4c8e-4027-a3a6-5749b52457bf tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:02.777194 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e0074052-4c8e-4027-a3a6-5749b52457bf tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.179835 Feb 21 01:37:02.777761 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 342/664] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:02 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:03.794732 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7aa402e7-1fbf-43f0-9995-d77d3e43cd0d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:03.796075 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7aa402e7-1fbf-43f0-9995-d77d3e43cd0d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:03.804021 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7aa402e7-1fbf-43f0-9995-d77d3e43cd0d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:03.804885 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7aa402e7-1fbf-43f0-9995-d77d3e43cd0d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:03.806034 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7aa402e7-1fbf-43f0-9995-d77d3e43cd0d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:03.806753 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7aa402e7-1fbf-43f0-9995-d77d3e43cd0d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:03.953299 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-7aa402e7-1fbf-43f0-9995-d77d3e43cd0d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:03.962858 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-7aa402e7-1fbf-43f0-9995-d77d3e43cd0d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:03.965176 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-7aa402e7-1fbf-43f0-9995-d77d3e43cd0d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:03.965944 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7aa402e7-1fbf-43f0-9995-d77d3e43cd0d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.174516 Feb 21 01:37:03.966380 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 323/665] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:03 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:04.984680 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6d7f219a-4d59-4f18-87c6-97695c79d670 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:04.985289 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6d7f219a-4d59-4f18-87c6-97695c79d670 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:04.991468 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d7f219a-4d59-4f18-87c6-97695c79d670 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:04.991912 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d7f219a-4d59-4f18-87c6-97695c79d670 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:04.992719 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d7f219a-4d59-4f18-87c6-97695c79d670 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:04.993150 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6d7f219a-4d59-4f18-87c6-97695c79d670 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:05.149381 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-6d7f219a-4d59-4f18-87c6-97695c79d670 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:05.159868 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-6d7f219a-4d59-4f18-87c6-97695c79d670 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:05.161447 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-6d7f219a-4d59-4f18-87c6-97695c79d670 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:05.162613 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6d7f219a-4d59-4f18-87c6-97695c79d670 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.181652 Feb 21 01:37:05.163172 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 343/666] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:04 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:06.182207 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0a2c8ef1-b264-43f4-bfcc-5844b066739d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:06.183759 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0a2c8ef1-b264-43f4-bfcc-5844b066739d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:06.190104 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a2c8ef1-b264-43f4-bfcc-5844b066739d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:06.190543 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a2c8ef1-b264-43f4-bfcc-5844b066739d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:06.191498 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a2c8ef1-b264-43f4-bfcc-5844b066739d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:06.192092 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0a2c8ef1-b264-43f4-bfcc-5844b066739d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:06.366095 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-0a2c8ef1-b264-43f4-bfcc-5844b066739d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:06.376267 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-0a2c8ef1-b264-43f4-bfcc-5844b066739d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:06.378044 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-0a2c8ef1-b264-43f4-bfcc-5844b066739d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:06.379247 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0a2c8ef1-b264-43f4-bfcc-5844b066739d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.200808 Feb 21 01:37:06.379798 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 324/667] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:06 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:07.399316 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5e879cae-caa6-4f3b-a8ec-95964a1c4168 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:07.400997 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5e879cae-caa6-4f3b-a8ec-95964a1c4168 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:07.407882 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e879cae-caa6-4f3b-a8ec-95964a1c4168 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:07.408332 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e879cae-caa6-4f3b-a8ec-95964a1c4168 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:07.409145 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e879cae-caa6-4f3b-a8ec-95964a1c4168 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:07.409578 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5e879cae-caa6-4f3b-a8ec-95964a1c4168 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:07.636530 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-5e879cae-caa6-4f3b-a8ec-95964a1c4168 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:07.645635 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-5e879cae-caa6-4f3b-a8ec-95964a1c4168 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:07.647325 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-5e879cae-caa6-4f3b-a8ec-95964a1c4168 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:07.655436 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5e879cae-caa6-4f3b-a8ec-95964a1c4168 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.261522 Feb 21 01:37:07.656134 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 344/668] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:07 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:08.674151 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5a1b1fdb-8a4a-4939-856f-b41679bd93f0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:08.675384 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5a1b1fdb-8a4a-4939-856f-b41679bd93f0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:08.701388 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a1b1fdb-8a4a-4939-856f-b41679bd93f0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:08.703241 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a1b1fdb-8a4a-4939-856f-b41679bd93f0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:08.709254 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a1b1fdb-8a4a-4939-856f-b41679bd93f0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:08.710000 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5a1b1fdb-8a4a-4939-856f-b41679bd93f0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:08.896636 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-5a1b1fdb-8a4a-4939-856f-b41679bd93f0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:08.906498 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-5a1b1fdb-8a4a-4939-856f-b41679bd93f0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:08.908447 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-5a1b1fdb-8a4a-4939-856f-b41679bd93f0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:08.910189 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5a1b1fdb-8a4a-4939-856f-b41679bd93f0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.240146 Feb 21 01:37:08.911744 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 325/669] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:08 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:09.931113 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e3ef6fdd-5a93-4a2e-96ea-7a196e8cec75 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:09.931113 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e3ef6fdd-5a93-4a2e-96ea-7a196e8cec75 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:09.936167 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3ef6fdd-5a93-4a2e-96ea-7a196e8cec75 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:09.936782 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3ef6fdd-5a93-4a2e-96ea-7a196e8cec75 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:09.937569 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3ef6fdd-5a93-4a2e-96ea-7a196e8cec75 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:09.938008 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e3ef6fdd-5a93-4a2e-96ea-7a196e8cec75 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:10.075304 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-e3ef6fdd-5a93-4a2e-96ea-7a196e8cec75 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:10.083734 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-e3ef6fdd-5a93-4a2e-96ea-7a196e8cec75 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:10.085321 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-e3ef6fdd-5a93-4a2e-96ea-7a196e8cec75 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:10.086385 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e3ef6fdd-5a93-4a2e-96ea-7a196e8cec75 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.160965 Feb 21 01:37:10.086942 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 345/670] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:09 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:11.105002 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-03c0e003-b9b5-43c2-82ef-881e2e35acd7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:11.105604 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-03c0e003-b9b5-43c2-82ef-881e2e35acd7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:11.111845 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-03c0e003-b9b5-43c2-82ef-881e2e35acd7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:11.112291 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-03c0e003-b9b5-43c2-82ef-881e2e35acd7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:11.113097 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-03c0e003-b9b5-43c2-82ef-881e2e35acd7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:11.113524 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-03c0e003-b9b5-43c2-82ef-881e2e35acd7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:11.245335 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-03c0e003-b9b5-43c2-82ef-881e2e35acd7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:11.253827 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-03c0e003-b9b5-43c2-82ef-881e2e35acd7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:11.255879 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-03c0e003-b9b5-43c2-82ef-881e2e35acd7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:11.257066 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-03c0e003-b9b5-43c2-82ef-881e2e35acd7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.155899 Feb 21 01:37:11.257623 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 326/671] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:11 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:11.756014 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8b2aa946-43a8-41f0-a37a-18526235337a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-912417865", "imageRef": "35936a71-5ec3-4154-b01a-f2dafd8c0364", "flavorRef": "452"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:37:11.804991 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-8b2aa946-43a8-41f0-a37a-18526235337a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] validate_networks() for None {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:37:12.072192 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-8b2aa946-43a8-41f0-a37a-18526235337a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:37:12.072643 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-8b2aa946-43a8-41f0-a37a-18526235337a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:37:12.073102 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-8b2aa946-43a8-41f0-a37a-18526235337a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:37:12.073501 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-8b2aa946-43a8-41f0-a37a-18526235337a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:37:12.073900 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-8b2aa946-43a8-41f0-a37a-18526235337a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:37:12.082791 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b2aa946-43a8-41f0-a37a-18526235337a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:12.083229 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b2aa946-43a8-41f0-a37a-18526235337a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:12.084020 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b2aa946-43a8-41f0-a37a-18526235337a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:12.084536 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b2aa946-43a8-41f0-a37a-18526235337a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:12.100635 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-8b2aa946-43a8-41f0-a37a-18526235337a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Getting quotas for project 8d11363c53ea4a7f9dd5d5c2534da543. Resources: {'ram', 'cores', 'instances'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:37:12.104296 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-8b2aa946-43a8-41f0-a37a-18526235337a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Getting quotas for user 1423bdc05ab34a96830ed491a9a64444 and project 8d11363c53ea4a7f9dd5d5c2534da543. Resources: {'ram', 'cores', 'instances'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:37:12.115095 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8b2aa946-43a8-41f0-a37a-18526235337a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:37:12.117403 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8b2aa946-43a8-41f0-a37a-18526235337a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] [instance: 9c001b37-1fa9-4dfc-830a-873c27e47b60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35936a71-5ec3-4154-b01a-f2dafd8c0364',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:37:12.216659 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8b2aa946-43a8-41f0-a37a-18526235337a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.464689 Feb 21 01:37:12.217302 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 346/672] 10.222.0.90 () {60 vars in 1146 bytes} [Mon Feb 21 01:37:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:37:12.227917 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8c79df7c-0056-4fd1-89ca-29b89334dccc tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:12.228648 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8c79df7c-0056-4fd1-89ca-29b89334dccc tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] [instance: 9c001b37-1fa9-4dfc-830a-873c27e47b60] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:12.283006 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-8c79df7c-0056-4fd1-89ca-29b89334dccc tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1423bdc05ab34a96830ed491a9a64444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d11363c53ea4a7f9dd5d5c2534da543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:12.290078 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8c79df7c-0056-4fd1-89ca-29b89334dccc tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] 10.222.0.90 "GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60" status: 200 len: 1214 microversion: 2.1 time: 0.066430 Feb 21 01:37:12.290734 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 327/673] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:12 2022] GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:37:12.459984 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8b5ecab6-64c8-42e3-b0f9-d72fd8ea1848 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:12.460630 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8b5ecab6-64c8-42e3-b0f9-d72fd8ea1848 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:12.469592 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b5ecab6-64c8-42e3-b0f9-d72fd8ea1848 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:12.470603 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b5ecab6-64c8-42e3-b0f9-d72fd8ea1848 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:12.471393 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b5ecab6-64c8-42e3-b0f9-d72fd8ea1848 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:12.472462 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8b5ecab6-64c8-42e3-b0f9-d72fd8ea1848 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:12.615127 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-8b5ecab6-64c8-42e3-b0f9-d72fd8ea1848 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:12.623651 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-8b5ecab6-64c8-42e3-b0f9-d72fd8ea1848 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:12.625164 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-8b5ecab6-64c8-42e3-b0f9-d72fd8ea1848 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:12.626313 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8b5ecab6-64c8-42e3-b0f9-d72fd8ea1848 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.354466 Feb 21 01:37:12.626862 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 347/674] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:12 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:13.307622 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c00fc0ab-5e3a-4a0b-8096-36c0fe5f5e1b tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:13.308237 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c00fc0ab-5e3a-4a0b-8096-36c0fe5f5e1b tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] [instance: 9c001b37-1fa9-4dfc-830a-873c27e47b60] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:13.386590 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c00fc0ab-5e3a-4a0b-8096-36c0fe5f5e1b tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1423bdc05ab34a96830ed491a9a64444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d11363c53ea4a7f9dd5d5c2534da543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:13.393359 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c00fc0ab-5e3a-4a0b-8096-36c0fe5f5e1b tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] 10.222.0.90 "GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60" status: 200 len: 1214 microversion: 2.1 time: 0.089549 Feb 21 01:37:13.393867 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 328/675] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:13 2022] GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:13.645314 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c4229489-63c7-43c9-9126-9e91ebf80f4e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:13.645855 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c4229489-63c7-43c9-9126-9e91ebf80f4e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:13.651823 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4229489-63c7-43c9-9126-9e91ebf80f4e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:13.653521 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4229489-63c7-43c9-9126-9e91ebf80f4e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:13.653521 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4229489-63c7-43c9-9126-9e91ebf80f4e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:13.653721 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4229489-63c7-43c9-9126-9e91ebf80f4e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:13.853571 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-c4229489-63c7-43c9-9126-9e91ebf80f4e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:13.861917 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-c4229489-63c7-43c9-9126-9e91ebf80f4e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:13.863413 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-c4229489-63c7-43c9-9126-9e91ebf80f4e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:13.864601 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c4229489-63c7-43c9-9126-9e91ebf80f4e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.223048 Feb 21 01:37:13.867464 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 348/676] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:13 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:14.409184 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4fdaf2fc-5199-48dc-97fa-3c7c85aabd1f tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:14.409800 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4fdaf2fc-5199-48dc-97fa-3c7c85aabd1f tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] [instance: 9c001b37-1fa9-4dfc-830a-873c27e47b60] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:14.416237 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fdaf2fc-5199-48dc-97fa-3c7c85aabd1f tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:14.416731 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fdaf2fc-5199-48dc-97fa-3c7c85aabd1f tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:14.417516 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fdaf2fc-5199-48dc-97fa-3c7c85aabd1f tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:14.417975 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4fdaf2fc-5199-48dc-97fa-3c7c85aabd1f tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:14.477151 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-4fdaf2fc-5199-48dc-97fa-3c7c85aabd1f tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1423bdc05ab34a96830ed491a9a64444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d11363c53ea4a7f9dd5d5c2534da543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:14.484793 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4fdaf2fc-5199-48dc-97fa-3c7c85aabd1f tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] 10.222.0.90 "GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60" status: 200 len: 1266 microversion: 2.1 time: 0.079275 Feb 21 01:37:14.485361 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 329/677] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:14 2022] GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60 => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:14.882840 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-74248fc8-4f4c-4673-a43c-c125a9517efa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:14.883537 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-74248fc8-4f4c-4673-a43c-c125a9517efa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:14.890216 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74248fc8-4f4c-4673-a43c-c125a9517efa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:14.892057 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74248fc8-4f4c-4673-a43c-c125a9517efa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:14.892057 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74248fc8-4f4c-4673-a43c-c125a9517efa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:14.892057 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-74248fc8-4f4c-4673-a43c-c125a9517efa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:15.141629 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-74248fc8-4f4c-4673-a43c-c125a9517efa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:15.150096 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-74248fc8-4f4c-4673-a43c-c125a9517efa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:15.151599 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-74248fc8-4f4c-4673-a43c-c125a9517efa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:15.153467 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-74248fc8-4f4c-4673-a43c-c125a9517efa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.274409 Feb 21 01:37:15.157959 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 349/678] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:14 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:15.503686 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-85f77d34-a516-42f9-aeff-84923761fc76 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:15.507583 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-85f77d34-a516-42f9-aeff-84923761fc76 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] [instance: 9c001b37-1fa9-4dfc-830a-873c27e47b60] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:15.512523 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85f77d34-a516-42f9-aeff-84923761fc76 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:15.512706 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85f77d34-a516-42f9-aeff-84923761fc76 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:15.513511 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85f77d34-a516-42f9-aeff-84923761fc76 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:15.513932 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-85f77d34-a516-42f9-aeff-84923761fc76 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:15.586940 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-85f77d34-a516-42f9-aeff-84923761fc76 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1423bdc05ab34a96830ed491a9a64444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d11363c53ea4a7f9dd5d5c2534da543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:15.594175 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-85f77d34-a516-42f9-aeff-84923761fc76 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] 10.222.0.90 "GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60" status: 200 len: 1272 microversion: 2.1 time: 0.095483 Feb 21 01:37:15.594732 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 330/679] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:15 2022] GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60 => generated 1272 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:16.176229 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-351dbea8-2cc1-4b0e-98c9-57664ead0997 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:16.177523 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-351dbea8-2cc1-4b0e-98c9-57664ead0997 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:16.184187 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-351dbea8-2cc1-4b0e-98c9-57664ead0997 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:16.184669 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-351dbea8-2cc1-4b0e-98c9-57664ead0997 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:16.185461 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-351dbea8-2cc1-4b0e-98c9-57664ead0997 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:16.185894 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-351dbea8-2cc1-4b0e-98c9-57664ead0997 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:16.450601 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-351dbea8-2cc1-4b0e-98c9-57664ead0997 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:16.458827 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-351dbea8-2cc1-4b0e-98c9-57664ead0997 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:16.460323 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-351dbea8-2cc1-4b0e-98c9-57664ead0997 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:16.461496 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-351dbea8-2cc1-4b0e-98c9-57664ead0997 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.289065 Feb 21 01:37:16.462059 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 350/680] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:16 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:16.611959 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c4513e93-951c-4067-9526-8f55c3998e66 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:16.612739 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c4513e93-951c-4067-9526-8f55c3998e66 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] [instance: 9c001b37-1fa9-4dfc-830a-873c27e47b60] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:16.620043 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4513e93-951c-4067-9526-8f55c3998e66 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:16.620526 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4513e93-951c-4067-9526-8f55c3998e66 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:16.621313 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4513e93-951c-4067-9526-8f55c3998e66 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:16.621747 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4513e93-951c-4067-9526-8f55c3998e66 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:16.856688 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c4513e93-951c-4067-9526-8f55c3998e66 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1423bdc05ab34a96830ed491a9a64444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d11363c53ea4a7f9dd5d5c2534da543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:16.864457 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c4513e93-951c-4067-9526-8f55c3998e66 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] 10.222.0.90 "GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60" status: 200 len: 1314 microversion: 2.1 time: 0.255857 Feb 21 01:37:16.865019 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 331/681] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:16 2022] GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:16.948748 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-c8db36d2-2f02-4923-803f-dc2eed1fd4dc req-36a222b8-372a-49f0-ac80-6806f4c83c3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c001b37-1fa9-4dfc-830a-873c27e47b60", "tag": "0234c718-d0d6-49f6-ad17-4a23f7c09963"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:37:16.950403 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:37:16.950403 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:37:16.962266 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c8db36d2-2f02-4923-803f-dc2eed1fd4dc req-36a222b8-372a-49f0-ac80-6806f4c83c3d service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:16.962826 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c8db36d2-2f02-4923-803f-dc2eed1fd4dc req-36a222b8-372a-49f0-ac80-6806f4c83c3d service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:16.974088 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-c8db36d2-2f02-4923-803f-dc2eed1fd4dc req-36a222b8-372a-49f0-ac80-6806f4c83c3d service nova] Creating event network-changed:0234c718-d0d6-49f6-ad17-4a23f7c09963 for instance 9c001b37-1fa9-4dfc-830a-873c27e47b60 on hv-cinder-81322 Feb 21 01:37:16.979166 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-c8db36d2-2f02-4923-803f-dc2eed1fd4dc req-36a222b8-372a-49f0-ac80-6806f4c83c3d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035298 Feb 21 01:37:16.979995 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 351/682] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:37:17.479407 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f944f24e-69da-4376-8840-a776b2dc95fd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:17.480153 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f944f24e-69da-4376-8840-a776b2dc95fd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:17.486560 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f944f24e-69da-4376-8840-a776b2dc95fd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:17.487012 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f944f24e-69da-4376-8840-a776b2dc95fd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:17.487872 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f944f24e-69da-4376-8840-a776b2dc95fd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:17.488378 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f944f24e-69da-4376-8840-a776b2dc95fd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:17.687288 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-f944f24e-69da-4376-8840-a776b2dc95fd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:17.696184 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-f944f24e-69da-4376-8840-a776b2dc95fd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:17.697689 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-f944f24e-69da-4376-8840-a776b2dc95fd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:17.698863 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f944f24e-69da-4376-8840-a776b2dc95fd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.223184 Feb 21 01:37:17.699408 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 332/683] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:17 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:17.881076 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3099aaa6-8666-4bd6-bc80-0af54b53cbae tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:17.881808 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3099aaa6-8666-4bd6-bc80-0af54b53cbae tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] [instance: 9c001b37-1fa9-4dfc-830a-873c27e47b60] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:17.888211 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3099aaa6-8666-4bd6-bc80-0af54b53cbae tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:17.888725 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3099aaa6-8666-4bd6-bc80-0af54b53cbae tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:17.889509 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3099aaa6-8666-4bd6-bc80-0af54b53cbae tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:17.889971 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3099aaa6-8666-4bd6-bc80-0af54b53cbae tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:18.025428 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-3099aaa6-8666-4bd6-bc80-0af54b53cbae tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1423bdc05ab34a96830ed491a9a64444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d11363c53ea4a7f9dd5d5c2534da543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:18.032829 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3099aaa6-8666-4bd6-bc80-0af54b53cbae tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] 10.222.0.90 "GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60" status: 200 len: 1314 microversion: 2.1 time: 0.156168 Feb 21 01:37:18.033476 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 352/684] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:17 2022] GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:18.716827 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a780a5d3-36ba-44a8-8cea-dc048348d80a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:18.717466 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a780a5d3-36ba-44a8-8cea-dc048348d80a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:18.723719 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a780a5d3-36ba-44a8-8cea-dc048348d80a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:18.724170 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a780a5d3-36ba-44a8-8cea-dc048348d80a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:18.724967 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a780a5d3-36ba-44a8-8cea-dc048348d80a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:18.725400 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a780a5d3-36ba-44a8-8cea-dc048348d80a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:18.856169 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-a780a5d3-36ba-44a8-8cea-dc048348d80a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:18.864597 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-a780a5d3-36ba-44a8-8cea-dc048348d80a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:18.866132 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-a780a5d3-36ba-44a8-8cea-dc048348d80a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:18.867312 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a780a5d3-36ba-44a8-8cea-dc048348d80a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.154250 Feb 21 01:37:18.867868 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 333/685] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:18 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:19.049943 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7a23e8ae-1fbf-441a-b0f2-f6615544a10f tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:19.050629 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7a23e8ae-1fbf-441a-b0f2-f6615544a10f tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] [instance: 9c001b37-1fa9-4dfc-830a-873c27e47b60] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:19.057360 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a23e8ae-1fbf-441a-b0f2-f6615544a10f tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:19.057799 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a23e8ae-1fbf-441a-b0f2-f6615544a10f tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:19.058640 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a23e8ae-1fbf-441a-b0f2-f6615544a10f tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:19.059066 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7a23e8ae-1fbf-441a-b0f2-f6615544a10f tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:19.185759 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-7a23e8ae-1fbf-441a-b0f2-f6615544a10f tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1423bdc05ab34a96830ed491a9a64444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d11363c53ea4a7f9dd5d5c2534da543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:19.193504 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7a23e8ae-1fbf-441a-b0f2-f6615544a10f tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] 10.222.0.90 "GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60" status: 200 len: 1314 microversion: 2.1 time: 0.147343 Feb 21 01:37:19.194057 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 353/686] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:19 2022] GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:19.885922 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2cc2a36e-5b85-461d-ba03-ca25535bec36 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:19.886533 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2cc2a36e-5b85-461d-ba03-ca25535bec36 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:19.892772 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2cc2a36e-5b85-461d-ba03-ca25535bec36 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:19.893217 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2cc2a36e-5b85-461d-ba03-ca25535bec36 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:19.893985 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2cc2a36e-5b85-461d-ba03-ca25535bec36 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:19.894413 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2cc2a36e-5b85-461d-ba03-ca25535bec36 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:20.025003 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-2cc2a36e-5b85-461d-ba03-ca25535bec36 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:20.033074 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-2cc2a36e-5b85-461d-ba03-ca25535bec36 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:20.034553 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-2cc2a36e-5b85-461d-ba03-ca25535bec36 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:20.035701 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2cc2a36e-5b85-461d-ba03-ca25535bec36 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.153764 Feb 21 01:37:20.036245 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 334/687] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:19 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:20.209834 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-623f2a39-b3e4-4b03-af6c-a2255856f1e8 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:20.210508 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-623f2a39-b3e4-4b03-af6c-a2255856f1e8 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] [instance: 9c001b37-1fa9-4dfc-830a-873c27e47b60] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:20.216653 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-623f2a39-b3e4-4b03-af6c-a2255856f1e8 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:20.217092 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-623f2a39-b3e4-4b03-af6c-a2255856f1e8 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:20.217847 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-623f2a39-b3e4-4b03-af6c-a2255856f1e8 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:20.218273 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-623f2a39-b3e4-4b03-af6c-a2255856f1e8 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:20.350104 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-623f2a39-b3e4-4b03-af6c-a2255856f1e8 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1423bdc05ab34a96830ed491a9a64444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d11363c53ea4a7f9dd5d5c2534da543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:20.357595 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-623f2a39-b3e4-4b03-af6c-a2255856f1e8 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] 10.222.0.90 "GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60" status: 200 len: 1314 microversion: 2.1 time: 0.151241 Feb 21 01:37:20.358415 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 354/688] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:20 2022] GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:21.052791 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0879c077-f78c-43b4-8128-9fff0b678510 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:21.053340 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0879c077-f78c-43b4-8128-9fff0b678510 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:21.059456 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0879c077-f78c-43b4-8128-9fff0b678510 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:21.060015 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0879c077-f78c-43b4-8128-9fff0b678510 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:21.060821 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0879c077-f78c-43b4-8128-9fff0b678510 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:21.061261 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0879c077-f78c-43b4-8128-9fff0b678510 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:21.191246 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-0879c077-f78c-43b4-8128-9fff0b678510 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:21.199793 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-0879c077-f78c-43b4-8128-9fff0b678510 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:21.201328 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-0879c077-f78c-43b4-8128-9fff0b678510 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:21.202475 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0879c077-f78c-43b4-8128-9fff0b678510 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.153481 Feb 21 01:37:21.203024 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 335/689] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:21 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:21.374758 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e333d48d-ebfe-4193-830c-bf8546039de1 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:21.375377 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e333d48d-ebfe-4193-830c-bf8546039de1 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] [instance: 9c001b37-1fa9-4dfc-830a-873c27e47b60] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:21.382294 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e333d48d-ebfe-4193-830c-bf8546039de1 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:21.382736 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e333d48d-ebfe-4193-830c-bf8546039de1 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:21.383573 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e333d48d-ebfe-4193-830c-bf8546039de1 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:21.384010 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e333d48d-ebfe-4193-830c-bf8546039de1 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:21.510977 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-e333d48d-ebfe-4193-830c-bf8546039de1 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1423bdc05ab34a96830ed491a9a64444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d11363c53ea4a7f9dd5d5c2534da543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:21.518123 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e333d48d-ebfe-4193-830c-bf8546039de1 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] 10.222.0.90 "GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60" status: 200 len: 1314 microversion: 2.1 time: 0.147036 Feb 21 01:37:21.518684 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 355/690] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:21 2022] GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:22.220210 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6c86dbb5-dbd5-4327-bf13-60d49af27e56 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:22.220878 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6c86dbb5-dbd5-4327-bf13-60d49af27e56 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:22.227107 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c86dbb5-dbd5-4327-bf13-60d49af27e56 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:22.227556 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c86dbb5-dbd5-4327-bf13-60d49af27e56 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:22.228325 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c86dbb5-dbd5-4327-bf13-60d49af27e56 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:22.228847 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c86dbb5-dbd5-4327-bf13-60d49af27e56 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:22.364453 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-6c86dbb5-dbd5-4327-bf13-60d49af27e56 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:22.373236 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-6c86dbb5-dbd5-4327-bf13-60d49af27e56 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:22.374739 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-6c86dbb5-dbd5-4327-bf13-60d49af27e56 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:22.375946 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6c86dbb5-dbd5-4327-bf13-60d49af27e56 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.159502 Feb 21 01:37:22.376497 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 336/691] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:22 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:22.534887 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7b145bbb-aa5f-43e5-ba50-4981bbc4b652 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:22.535503 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7b145bbb-aa5f-43e5-ba50-4981bbc4b652 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] [instance: 9c001b37-1fa9-4dfc-830a-873c27e47b60] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:22.542338 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b145bbb-aa5f-43e5-ba50-4981bbc4b652 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:22.542785 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b145bbb-aa5f-43e5-ba50-4981bbc4b652 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:22.543757 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b145bbb-aa5f-43e5-ba50-4981bbc4b652 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:22.544196 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7b145bbb-aa5f-43e5-ba50-4981bbc4b652 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:22.680311 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-7b145bbb-aa5f-43e5-ba50-4981bbc4b652 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1423bdc05ab34a96830ed491a9a64444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d11363c53ea4a7f9dd5d5c2534da543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:22.687677 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7b145bbb-aa5f-43e5-ba50-4981bbc4b652 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] 10.222.0.90 "GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60" status: 200 len: 1314 microversion: 2.1 time: 0.156520 Feb 21 01:37:22.688271 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 356/692] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:22 2022] GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:23.395208 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-41255762-ca64-43f5-afc2-7fc4354b86d4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:23.395973 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-41255762-ca64-43f5-afc2-7fc4354b86d4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:23.402360 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-41255762-ca64-43f5-afc2-7fc4354b86d4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:23.403002 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-41255762-ca64-43f5-afc2-7fc4354b86d4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:23.403815 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-41255762-ca64-43f5-afc2-7fc4354b86d4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:23.404255 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-41255762-ca64-43f5-afc2-7fc4354b86d4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:23.538707 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-41255762-ca64-43f5-afc2-7fc4354b86d4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:23.546966 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-41255762-ca64-43f5-afc2-7fc4354b86d4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:23.548501 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-41255762-ca64-43f5-afc2-7fc4354b86d4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:23.549657 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-41255762-ca64-43f5-afc2-7fc4354b86d4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.158639 Feb 21 01:37:23.550291 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 337/693] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:23 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:23.703783 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e1c84b6d-d582-4e7e-a11c-aa48ff3da5c2 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:23.704415 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e1c84b6d-d582-4e7e-a11c-aa48ff3da5c2 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] [instance: 9c001b37-1fa9-4dfc-830a-873c27e47b60] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:23.710642 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1c84b6d-d582-4e7e-a11c-aa48ff3da5c2 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:23.711129 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1c84b6d-d582-4e7e-a11c-aa48ff3da5c2 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:23.711950 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1c84b6d-d582-4e7e-a11c-aa48ff3da5c2 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:23.712379 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e1c84b6d-d582-4e7e-a11c-aa48ff3da5c2 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:23.842204 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-e1c84b6d-d582-4e7e-a11c-aa48ff3da5c2 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1423bdc05ab34a96830ed491a9a64444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d11363c53ea4a7f9dd5d5c2534da543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:23.849806 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e1c84b6d-d582-4e7e-a11c-aa48ff3da5c2 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] 10.222.0.90 "GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60" status: 200 len: 1314 microversion: 2.1 time: 0.149693 Feb 21 01:37:23.850364 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 357/694] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:23 2022] GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:24.568980 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7183d52f-e7ad-478f-bb33-7435b74c527d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:24.569590 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7183d52f-e7ad-478f-bb33-7435b74c527d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:24.575881 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7183d52f-e7ad-478f-bb33-7435b74c527d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:24.576349 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7183d52f-e7ad-478f-bb33-7435b74c527d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:24.577197 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7183d52f-e7ad-478f-bb33-7435b74c527d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:24.577648 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7183d52f-e7ad-478f-bb33-7435b74c527d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:24.714878 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-7183d52f-e7ad-478f-bb33-7435b74c527d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:24.723038 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-7183d52f-e7ad-478f-bb33-7435b74c527d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:24.724720 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-7183d52f-e7ad-478f-bb33-7435b74c527d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:24.725852 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7183d52f-e7ad-478f-bb33-7435b74c527d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.161372 Feb 21 01:37:24.726597 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 338/695] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:24 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:24.866130 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-28d36332-a2e2-4eb0-a80b-a09637acbdae tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:24.866747 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-28d36332-a2e2-4eb0-a80b-a09637acbdae tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] [instance: 9c001b37-1fa9-4dfc-830a-873c27e47b60] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:24.872950 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28d36332-a2e2-4eb0-a80b-a09637acbdae tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:24.873402 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28d36332-a2e2-4eb0-a80b-a09637acbdae tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:24.874256 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28d36332-a2e2-4eb0-a80b-a09637acbdae tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:24.874620 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-28d36332-a2e2-4eb0-a80b-a09637acbdae tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:25.012902 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-28d36332-a2e2-4eb0-a80b-a09637acbdae tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1423bdc05ab34a96830ed491a9a64444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d11363c53ea4a7f9dd5d5c2534da543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:25.020105 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-28d36332-a2e2-4eb0-a80b-a09637acbdae tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] 10.222.0.90 "GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60" status: 200 len: 1314 microversion: 2.1 time: 0.157602 Feb 21 01:37:25.020701 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 358/696] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:24 2022] GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:25.743505 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2aef4a65-acf2-4b56-ac5b-70aa68752e2c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:25.744109 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2aef4a65-acf2-4b56-ac5b-70aa68752e2c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:25.749986 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2aef4a65-acf2-4b56-ac5b-70aa68752e2c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:25.750425 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2aef4a65-acf2-4b56-ac5b-70aa68752e2c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:25.751183 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2aef4a65-acf2-4b56-ac5b-70aa68752e2c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:25.751604 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2aef4a65-acf2-4b56-ac5b-70aa68752e2c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:25.882835 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-2aef4a65-acf2-4b56-ac5b-70aa68752e2c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:25.891048 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-2aef4a65-acf2-4b56-ac5b-70aa68752e2c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:25.892554 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-2aef4a65-acf2-4b56-ac5b-70aa68752e2c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:25.893684 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2aef4a65-acf2-4b56-ac5b-70aa68752e2c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.154256 Feb 21 01:37:25.894232 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 339/697] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:25 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:26.037477 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-627c42c4-cc2e-4867-9719-8cfe60c4f2b0 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:26.038092 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-627c42c4-cc2e-4867-9719-8cfe60c4f2b0 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] [instance: 9c001b37-1fa9-4dfc-830a-873c27e47b60] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:26.044538 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-627c42c4-cc2e-4867-9719-8cfe60c4f2b0 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:26.044994 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-627c42c4-cc2e-4867-9719-8cfe60c4f2b0 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:26.045770 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-627c42c4-cc2e-4867-9719-8cfe60c4f2b0 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:26.046206 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-627c42c4-cc2e-4867-9719-8cfe60c4f2b0 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:26.176420 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-627c42c4-cc2e-4867-9719-8cfe60c4f2b0 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1423bdc05ab34a96830ed491a9a64444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d11363c53ea4a7f9dd5d5c2534da543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:26.183472 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-627c42c4-cc2e-4867-9719-8cfe60c4f2b0 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] 10.222.0.90 "GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60" status: 200 len: 1314 microversion: 2.1 time: 0.150341 Feb 21 01:37:26.184372 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 359/698] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:26 2022] GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:26.514702 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-e0d58fd9-3637-4276-b7ee-6a500a89e020 req-596aa6df-ab13-4341-8057-44412711019a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c001b37-1fa9-4dfc-830a-873c27e47b60", "name": "network-vif-plugged", "status": "completed", "tag": "0234c718-d0d6-49f6-ad17-4a23f7c09963"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:37:26.516508 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:37:26.516508 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:37:26.523322 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e0d58fd9-3637-4276-b7ee-6a500a89e020 req-596aa6df-ab13-4341-8057-44412711019a service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:26.523761 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e0d58fd9-3637-4276-b7ee-6a500a89e020 req-596aa6df-ab13-4341-8057-44412711019a service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:26.534399 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-e0d58fd9-3637-4276-b7ee-6a500a89e020 req-596aa6df-ab13-4341-8057-44412711019a service nova] Creating event network-vif-plugged:0234c718-d0d6-49f6-ad17-4a23f7c09963 for instance 9c001b37-1fa9-4dfc-830a-873c27e47b60 on hv-cinder-81322 Feb 21 01:37:26.539588 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-e0d58fd9-3637-4276-b7ee-6a500a89e020 req-596aa6df-ab13-4341-8057-44412711019a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028446 Feb 21 01:37:26.540381 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 340/699] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:37:26.911731 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1c811ff6-ca87-4547-a40e-09deb5179f87 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:26.912275 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1c811ff6-ca87-4547-a40e-09deb5179f87 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:26.917974 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c811ff6-ca87-4547-a40e-09deb5179f87 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:26.921229 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c811ff6-ca87-4547-a40e-09deb5179f87 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:26.921229 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c811ff6-ca87-4547-a40e-09deb5179f87 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:26.921229 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c811ff6-ca87-4547-a40e-09deb5179f87 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:27.202015 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6406a49f-f0b7-4139-9cec-7d48b8bab81a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:27.202796 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6406a49f-f0b7-4139-9cec-7d48b8bab81a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] [instance: 9c001b37-1fa9-4dfc-830a-873c27e47b60] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:27.209549 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6406a49f-f0b7-4139-9cec-7d48b8bab81a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:27.210000 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6406a49f-f0b7-4139-9cec-7d48b8bab81a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:27.210781 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6406a49f-f0b7-4139-9cec-7d48b8bab81a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:27.211354 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6406a49f-f0b7-4139-9cec-7d48b8bab81a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:27.368673 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1c811ff6-ca87-4547-a40e-09deb5179f87 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:27.377777 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1c811ff6-ca87-4547-a40e-09deb5179f87 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:27.379489 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1c811ff6-ca87-4547-a40e-09deb5179f87 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:27.380839 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1c811ff6-ca87-4547-a40e-09deb5179f87 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.473350 Feb 21 01:37:27.381492 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 360/700] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:26 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:27.394175 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-6406a49f-f0b7-4139-9cec-7d48b8bab81a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1423bdc05ab34a96830ed491a9a64444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d11363c53ea4a7f9dd5d5c2534da543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:27.402194 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6406a49f-f0b7-4139-9cec-7d48b8bab81a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] 10.222.0.90 "GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60" status: 200 len: 1314 microversion: 2.1 time: 0.204762 Feb 21 01:37:27.402752 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 341/701] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:27 2022] GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:37:28.401570 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2e20d6b6-5611-458b-88c7-5af7f13d4598 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:28.402280 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2e20d6b6-5611-458b-88c7-5af7f13d4598 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:28.408913 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e20d6b6-5611-458b-88c7-5af7f13d4598 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:28.409470 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e20d6b6-5611-458b-88c7-5af7f13d4598 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:28.410258 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e20d6b6-5611-458b-88c7-5af7f13d4598 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:28.410910 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e20d6b6-5611-458b-88c7-5af7f13d4598 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:28.424389 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2c16d160-7691-4225-9a46-3981cbe376e2 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:28.425030 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2c16d160-7691-4225-9a46-3981cbe376e2 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] [instance: 9c001b37-1fa9-4dfc-830a-873c27e47b60] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:28.431788 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c16d160-7691-4225-9a46-3981cbe376e2 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:28.432236 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c16d160-7691-4225-9a46-3981cbe376e2 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:28.433244 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c16d160-7691-4225-9a46-3981cbe376e2 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:28.433678 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2c16d160-7691-4225-9a46-3981cbe376e2 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:28.617388 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2e20d6b6-5611-458b-88c7-5af7f13d4598 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:28.622778 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-2c16d160-7691-4225-9a46-3981cbe376e2 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1423bdc05ab34a96830ed491a9a64444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d11363c53ea4a7f9dd5d5c2534da543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:28.628454 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2e20d6b6-5611-458b-88c7-5af7f13d4598 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:28.630509 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2c16d160-7691-4225-9a46-3981cbe376e2 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] 10.222.0.90 "GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60" status: 200 len: 1314 microversion: 2.1 time: 0.209237 Feb 21 01:37:28.631090 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 342/702] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:28 2022] GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:37:28.631454 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2e20d6b6-5611-458b-88c7-5af7f13d4598 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:28.632801 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2e20d6b6-5611-458b-88c7-5af7f13d4598 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.234932 Feb 21 01:37:28.636467 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 361/703] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:28 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:28.636586 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-f5596a0f-95b3-4f27-9652-eba350deda8c req-7dd177e5-cdb5-451c-a76e-45f97021ff55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "962b0526-5a3e-4044-a74f-34fe41f7717d", "name": "network-vif-plugged", "status": "completed", "tag": "d7edbb2e-2fa7-4065-ba3b-97a6d16d31e7"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:37:28.637756 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:37:28.637756 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:37:28.644698 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f5596a0f-95b3-4f27-9652-eba350deda8c req-7dd177e5-cdb5-451c-a76e-45f97021ff55 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:28.645146 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-f5596a0f-95b3-4f27-9652-eba350deda8c req-7dd177e5-cdb5-451c-a76e-45f97021ff55 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:28.658780 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-f5596a0f-95b3-4f27-9652-eba350deda8c req-7dd177e5-cdb5-451c-a76e-45f97021ff55 service nova] Creating event network-vif-plugged:d7edbb2e-2fa7-4065-ba3b-97a6d16d31e7 for instance 962b0526-5a3e-4044-a74f-34fe41f7717d on hv-cinder-81322 Feb 21 01:37:28.664965 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-f5596a0f-95b3-4f27-9652-eba350deda8c req-7dd177e5-cdb5-451c-a76e-45f97021ff55 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032703 Feb 21 01:37:28.665727 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 343/704] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:37:29.647397 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-626f1816-bedd-454b-91fd-8d9e079aa591 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:29.647922 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-626f1816-bedd-454b-91fd-8d9e079aa591 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] [instance: 9c001b37-1fa9-4dfc-830a-873c27e47b60] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:29.652149 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3576c206-d474-4a01-bad8-1dc5da9c6271 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:29.653740 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3576c206-d474-4a01-bad8-1dc5da9c6271 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:29.654084 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-626f1816-bedd-454b-91fd-8d9e079aa591 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:29.654535 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-626f1816-bedd-454b-91fd-8d9e079aa591 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:29.655315 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-626f1816-bedd-454b-91fd-8d9e079aa591 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:29.655805 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-626f1816-bedd-454b-91fd-8d9e079aa591 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:29.660415 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3576c206-d474-4a01-bad8-1dc5da9c6271 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:29.661693 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3576c206-d474-4a01-bad8-1dc5da9c6271 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:29.662496 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3576c206-d474-4a01-bad8-1dc5da9c6271 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:29.662934 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3576c206-d474-4a01-bad8-1dc5da9c6271 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:29.855586 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-626f1816-bedd-454b-91fd-8d9e079aa591 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1423bdc05ab34a96830ed491a9a64444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d11363c53ea4a7f9dd5d5c2534da543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:29.862165 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-3576c206-d474-4a01-bad8-1dc5da9c6271 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:29.862972 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-626f1816-bedd-454b-91fd-8d9e079aa591 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] 10.222.0.90 "GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60" status: 200 len: 1463 microversion: 2.1 time: 0.219773 Feb 21 01:37:29.863544 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 362/705] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:29 2022] GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60 => generated 1463 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:29.870396 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-3576c206-d474-4a01-bad8-1dc5da9c6271 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:29.871878 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-3576c206-d474-4a01-bad8-1dc5da9c6271 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:29.873028 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3576c206-d474-4a01-bad8-1dc5da9c6271 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.225330 Feb 21 01:37:29.873575 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 344/706] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:29 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:37:29.902165 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5136cd63-cc28-407b-a18f-b727b7d2f0b5 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:29.902592 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5136cd63-cc28-407b-a18f-b727b7d2f0b5 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] [instance: 9c001b37-1fa9-4dfc-830a-873c27e47b60] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:29.908458 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5136cd63-cc28-407b-a18f-b727b7d2f0b5 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:29.908899 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5136cd63-cc28-407b-a18f-b727b7d2f0b5 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:29.909697 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5136cd63-cc28-407b-a18f-b727b7d2f0b5 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:29.910131 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5136cd63-cc28-407b-a18f-b727b7d2f0b5 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:29.933578 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5136cd63-cc28-407b-a18f-b727b7d2f0b5 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] [instance: 9c001b37-1fa9-4dfc-830a-873c27e47b60] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:37:30.209678 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5136cd63-cc28-407b-a18f-b727b7d2f0b5 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] 10.222.0.90 "DELETE /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60" status: 204 len: 0 microversion: 2.1 time: 0.310845 Feb 21 01:37:30.210303 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 363/707] 10.222.0.90 () {58 vars in 1238 bytes} [Mon Feb 21 01:37:29 2022] DELETE /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:37:30.218129 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-21f10a0e-6d16-4d8a-8bff-0641743038a0 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:30.224274 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-21f10a0e-6d16-4d8a-8bff-0641743038a0 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] [instance: 9c001b37-1fa9-4dfc-830a-873c27e47b60] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:30.224560 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21f10a0e-6d16-4d8a-8bff-0641743038a0 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:30.225008 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21f10a0e-6d16-4d8a-8bff-0641743038a0 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:30.225768 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21f10a0e-6d16-4d8a-8bff-0641743038a0 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:30.226196 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21f10a0e-6d16-4d8a-8bff-0641743038a0 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:30.358542 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-21f10a0e-6d16-4d8a-8bff-0641743038a0 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1423bdc05ab34a96830ed491a9a64444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d11363c53ea4a7f9dd5d5c2534da543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:30.366313 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-21f10a0e-6d16-4d8a-8bff-0641743038a0 tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] 10.222.0.90 "GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60" status: 200 len: 1469 microversion: 2.1 time: 0.151738 Feb 21 01:37:30.366983 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 345/708] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:30 2022] GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60 => generated 1469 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:30.892038 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-93f57a86-2931-4345-9724-307ae5a523f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:30.892776 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-93f57a86-2931-4345-9724-307ae5a523f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:30.899043 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-93f57a86-2931-4345-9724-307ae5a523f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:30.899581 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-93f57a86-2931-4345-9724-307ae5a523f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:30.900434 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-93f57a86-2931-4345-9724-307ae5a523f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:30.900872 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-93f57a86-2931-4345-9724-307ae5a523f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:31.034362 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-93f57a86-2931-4345-9724-307ae5a523f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:31.043107 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-93f57a86-2931-4345-9724-307ae5a523f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:31.044642 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-93f57a86-2931-4345-9724-307ae5a523f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:31.045793 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-93f57a86-2931-4345-9724-307ae5a523f6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.158005 Feb 21 01:37:31.046350 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 364/709] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:30 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:31.383166 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-26bd81a9-12e3-4d56-8782-8eeca41d536b tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:31.387000 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-26bd81a9-12e3-4d56-8782-8eeca41d536b tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] [instance: 9c001b37-1fa9-4dfc-830a-873c27e47b60] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:31.390226 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26bd81a9-12e3-4d56-8782-8eeca41d536b tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:31.390663 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26bd81a9-12e3-4d56-8782-8eeca41d536b tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:31.391418 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26bd81a9-12e3-4d56-8782-8eeca41d536b tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:31.391844 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-26bd81a9-12e3-4d56-8782-8eeca41d536b tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:31.527871 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-26bd81a9-12e3-4d56-8782-8eeca41d536b tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1423bdc05ab34a96830ed491a9a64444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d11363c53ea4a7f9dd5d5c2534da543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:31.535478 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-26bd81a9-12e3-4d56-8782-8eeca41d536b tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] 10.222.0.90 "GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60" status: 200 len: 1469 microversion: 2.1 time: 0.156376 Feb 21 01:37:31.536158 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 346/710] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:31 2022] GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60 => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:32.084172 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b0ab2560-7606-4872-a342-9bb53b3b0d21 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:32.084172 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b0ab2560-7606-4872-a342-9bb53b3b0d21 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:32.084172 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b0ab2560-7606-4872-a342-9bb53b3b0d21 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:32.084172 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b0ab2560-7606-4872-a342-9bb53b3b0d21 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:32.085105 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b0ab2560-7606-4872-a342-9bb53b3b0d21 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:32.085105 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b0ab2560-7606-4872-a342-9bb53b3b0d21 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:32.345019 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b0ab2560-7606-4872-a342-9bb53b3b0d21 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:32.345019 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b0ab2560-7606-4872-a342-9bb53b3b0d21 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:32.345228 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b0ab2560-7606-4872-a342-9bb53b3b0d21 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:32.345228 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b0ab2560-7606-4872-a342-9bb53b3b0d21 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.183277 Feb 21 01:37:32.345228 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 365/711] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:32 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:32.552091 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6c727a2a-b4f4-4431-a9a3-a51c0ac3136a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:32.579543 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6c727a2a-b4f4-4431-a9a3-a51c0ac3136a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] [instance: 9c001b37-1fa9-4dfc-830a-873c27e47b60] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:32.579543 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c727a2a-b4f4-4431-a9a3-a51c0ac3136a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:32.579543 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c727a2a-b4f4-4431-a9a3-a51c0ac3136a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:32.579543 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c727a2a-b4f4-4431-a9a3-a51c0ac3136a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:32.580271 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c727a2a-b4f4-4431-a9a3-a51c0ac3136a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:32.817047 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-6c727a2a-b4f4-4431-a9a3-a51c0ac3136a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1423bdc05ab34a96830ed491a9a64444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d11363c53ea4a7f9dd5d5c2534da543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:32.824971 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6c727a2a-b4f4-4431-a9a3-a51c0ac3136a tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] 10.222.0.90 "GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60" status: 200 len: 1469 microversion: 2.1 time: 0.276587 Feb 21 01:37:32.825542 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 347/712] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:32 2022] GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60 => generated 1469 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:33.289981 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-7656227a-55e7-4def-bfa6-fe24dc605848 req-4ff40274-c133-4031-ab2c-ba582eab909d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c001b37-1fa9-4dfc-830a-873c27e47b60", "name": "network-vif-deleted", "tag": "0234c718-d0d6-49f6-ad17-4a23f7c09963"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:37:33.292879 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:37:33.292879 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:37:33.298643 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7656227a-55e7-4def-bfa6-fe24dc605848 req-4ff40274-c133-4031-ab2c-ba582eab909d service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:33.299035 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7656227a-55e7-4def-bfa6-fe24dc605848 req-4ff40274-c133-4031-ab2c-ba582eab909d service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:33.311892 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-7656227a-55e7-4def-bfa6-fe24dc605848 req-4ff40274-c133-4031-ab2c-ba582eab909d service nova] Creating event network-vif-deleted:0234c718-d0d6-49f6-ad17-4a23f7c09963 for instance 9c001b37-1fa9-4dfc-830a-873c27e47b60 on hv-cinder-81322 Feb 21 01:37:33.316760 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-7656227a-55e7-4def-bfa6-fe24dc605848 req-4ff40274-c133-4031-ab2c-ba582eab909d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189374 Feb 21 01:37:33.317973 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 366/713] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:37:33.361311 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d1685832-f95e-4864-937c-a1eb8a4a3c39 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:33.361928 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d1685832-f95e-4864-937c-a1eb8a4a3c39 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:33.368224 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1685832-f95e-4864-937c-a1eb8a4a3c39 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:33.368706 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1685832-f95e-4864-937c-a1eb8a4a3c39 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:33.369482 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1685832-f95e-4864-937c-a1eb8a4a3c39 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:33.369916 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d1685832-f95e-4864-937c-a1eb8a4a3c39 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:33.507081 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-d1685832-f95e-4864-937c-a1eb8a4a3c39 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:33.516169 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-d1685832-f95e-4864-937c-a1eb8a4a3c39 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:33.517683 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-d1685832-f95e-4864-937c-a1eb8a4a3c39 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:33.518851 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d1685832-f95e-4864-937c-a1eb8a4a3c39 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1807 microversion: 2.20 time: 0.161384 Feb 21 01:37:33.519401 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 348/714] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:33 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:33.844837 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c3e8f561-dc20-45fb-9995-9a38afda9f3b tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:33.845601 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c3e8f561-dc20-45fb-9995-9a38afda9f3b tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] [instance: 9c001b37-1fa9-4dfc-830a-873c27e47b60] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:33.851950 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3e8f561-dc20-45fb-9995-9a38afda9f3b tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:33.852397 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3e8f561-dc20-45fb-9995-9a38afda9f3b tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:33.853200 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3e8f561-dc20-45fb-9995-9a38afda9f3b tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:33.853632 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3e8f561-dc20-45fb-9995-9a38afda9f3b tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:33.883093 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3e8f561-dc20-45fb-9995-9a38afda9f3b tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:33.883538 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3e8f561-dc20-45fb-9995-9a38afda9f3b tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:33.883988 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-c3e8f561-dc20-45fb-9995-9a38afda9f3b tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lazy-loading 'fault' on Instance uuid 9c001b37-1fa9-4dfc-830a-873c27e47b60 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:37:33.923667 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-c3e8f561-dc20-45fb-9995-9a38afda9f3b tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1423bdc05ab34a96830ed491a9a64444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d11363c53ea4a7f9dd5d5c2534da543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:33.931595 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c3e8f561-dc20-45fb-9995-9a38afda9f3b tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] 10.222.0.90 "GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60" status: 200 len: 1304 microversion: 2.1 time: 0.090836 Feb 21 01:37:33.932164 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 367/715] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:33 2022] GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60 => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:34.537083 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cb2a3ef6-fdde-4c52-af5c-7cb9bad24362 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:34.537682 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cb2a3ef6-fdde-4c52-af5c-7cb9bad24362 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:34.544068 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb2a3ef6-fdde-4c52-af5c-7cb9bad24362 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:34.548587 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb2a3ef6-fdde-4c52-af5c-7cb9bad24362 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:34.548587 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb2a3ef6-fdde-4c52-af5c-7cb9bad24362 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:34.548587 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cb2a3ef6-fdde-4c52-af5c-7cb9bad24362 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:34.677248 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-cb2a3ef6-fdde-4c52-af5c-7cb9bad24362 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:34.686221 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-cb2a3ef6-fdde-4c52-af5c-7cb9bad24362 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:34.687791 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-cb2a3ef6-fdde-4c52-af5c-7cb9bad24362 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:34.688989 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cb2a3ef6-fdde-4c52-af5c-7cb9bad24362 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1794 microversion: 2.20 time: 0.156112 Feb 21 01:37:34.689556 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 349/716] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:37:34 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1794 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:37:34.951701 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ba6f4b24-e5dd-4d85-8871-faddfcfa9cee tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:34.952256 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ba6f4b24-e5dd-4d85-8871-faddfcfa9cee tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] [instance: 9c001b37-1fa9-4dfc-830a-873c27e47b60] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:34.958904 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba6f4b24-e5dd-4d85-8871-faddfcfa9cee tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:34.959346 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba6f4b24-e5dd-4d85-8871-faddfcfa9cee tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:34.960112 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba6f4b24-e5dd-4d85-8871-faddfcfa9cee tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:34.960566 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba6f4b24-e5dd-4d85-8871-faddfcfa9cee tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:34.974073 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-ba6f4b24-e5dd-4d85-8871-faddfcfa9cee tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] HTTP exception thrown: Instance 9c001b37-1fa9-4dfc-830a-873c27e47b60 could not be found. Feb 21 01:37:34.974643 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ba6f4b24-e5dd-4d85-8871-faddfcfa9cee tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] Returning 404 to user: Instance 9c001b37-1fa9-4dfc-830a-873c27e47b60 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:37:34.975466 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ba6f4b24-e5dd-4d85-8871-faddfcfa9cee tempest-VolumesNegativeTest-460063819 tempest-VolumesNegativeTest-460063819-project] 10.222.0.90 "GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60" status: 404 len: 111 microversion: 2.1 time: 0.027508 Feb 21 01:37:34.975979 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 368/717] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:34 2022] GET /compute/v2.1/servers/9c001b37-1fa9-4dfc-830a-873c27e47b60 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 21 01:37:45.969332 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bc29be3e-02c1-4d5f-b6dc-543fe73a62d6 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:37:45.970474 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bc29be3e-02c1-4d5f-b6dc-543fe73a62d6 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:45.977035 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bc29be3e-02c1-4d5f-b6dc-543fe73a62d6 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:45.977475 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bc29be3e-02c1-4d5f-b6dc-543fe73a62d6 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:45.978316 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bc29be3e-02c1-4d5f-b6dc-543fe73a62d6 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:45.979758 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bc29be3e-02c1-4d5f-b6dc-543fe73a62d6 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:46.201541 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bc29be3e-02c1-4d5f-b6dc-543fe73a62d6 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "POST /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04/action" status: 202 len: 0 microversion: 2.1 time: 0.235713 Feb 21 01:37:46.202374 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 350/718] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Feb 21 01:37:45 2022] POST /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:37:46.210079 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5be42fb4-c79c-4a53-a7bb-6b22c8a7822f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:46.210693 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5be42fb4-c79c-4a53-a7bb-6b22c8a7822f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:46.216645 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5be42fb4-c79c-4a53-a7bb-6b22c8a7822f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:46.217098 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5be42fb4-c79c-4a53-a7bb-6b22c8a7822f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:46.218035 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5be42fb4-c79c-4a53-a7bb-6b22c8a7822f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:46.218482 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5be42fb4-c79c-4a53-a7bb-6b22c8a7822f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:46.400014 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-5be42fb4-c79c-4a53-a7bb-6b22c8a7822f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:46.407770 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5be42fb4-c79c-4a53-a7bb-6b22c8a7822f tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1752 microversion: 2.1 time: 0.201446 Feb 21 01:37:46.408330 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 369/719] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:46 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1752 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:47.426076 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-35f43bdb-53be-4efd-b88f-5d02384c4431 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:47.427259 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-35f43bdb-53be-4efd-b88f-5d02384c4431 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:47.433261 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35f43bdb-53be-4efd-b88f-5d02384c4431 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:47.433710 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35f43bdb-53be-4efd-b88f-5d02384c4431 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:47.434476 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35f43bdb-53be-4efd-b88f-5d02384c4431 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:47.434905 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35f43bdb-53be-4efd-b88f-5d02384c4431 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:47.579910 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-35f43bdb-53be-4efd-b88f-5d02384c4431 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:47.587657 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-35f43bdb-53be-4efd-b88f-5d02384c4431 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1752 microversion: 2.1 time: 0.166009 Feb 21 01:37:47.588221 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 351/720] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:47 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:48.605045 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f60571b7-658c-4fac-a876-3cfeadde40b5 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:48.605709 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f60571b7-658c-4fac-a876-3cfeadde40b5 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:48.611908 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f60571b7-658c-4fac-a876-3cfeadde40b5 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:48.612359 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f60571b7-658c-4fac-a876-3cfeadde40b5 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:48.613179 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f60571b7-658c-4fac-a876-3cfeadde40b5 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:48.613615 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f60571b7-658c-4fac-a876-3cfeadde40b5 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:48.763124 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-f60571b7-658c-4fac-a876-3cfeadde40b5 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:48.770880 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f60571b7-658c-4fac-a876-3cfeadde40b5 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1752 microversion: 2.1 time: 0.169743 Feb 21 01:37:48.771451 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 370/721] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:48 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:49.786928 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6c6e46fe-4150-49af-8b4a-ecd87741c112 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:49.787540 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6c6e46fe-4150-49af-8b4a-ecd87741c112 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:49.793835 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c6e46fe-4150-49af-8b4a-ecd87741c112 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:49.794285 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c6e46fe-4150-49af-8b4a-ecd87741c112 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:49.795065 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c6e46fe-4150-49af-8b4a-ecd87741c112 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:49.795500 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c6e46fe-4150-49af-8b4a-ecd87741c112 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:49.935654 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-6c6e46fe-4150-49af-8b4a-ecd87741c112 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:49.943983 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6c6e46fe-4150-49af-8b4a-ecd87741c112 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1757 microversion: 2.1 time: 0.160738 Feb 21 01:37:49.944584 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 352/722] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:49 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:50.387431 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e12122a2-e46e-4f55-a7f6-c39538d72831 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:50.387431 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e12122a2-e46e-4f55-a7f6-c39538d72831 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:50.389018 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e12122a2-e46e-4f55-a7f6-c39538d72831 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:50.389469 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e12122a2-e46e-4f55-a7f6-c39538d72831 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:50.390241 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e12122a2-e46e-4f55-a7f6-c39538d72831 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:50.390674 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e12122a2-e46e-4f55-a7f6-c39538d72831 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:50.467011 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-e12122a2-e46e-4f55-a7f6-c39538d72831 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lazy-loading 'services' on Instance uuid ff526a32-96c9-4481-a88c-a0913652acfd {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:37:50.688048 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e12122a2-e46e-4f55-a7f6-c39538d72831 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd/os-volume_attachments/a331acc5-865a-4eb2-ab52-68364af9726c" status: 202 len: 0 microversion: 2.1 time: 0.463136 Feb 21 01:37:50.688604 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 371/723] 10.222.0.90 () {58 vars in 1415 bytes} [Mon Feb 21 01:37:50 2022] DELETE /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd/os-volume_attachments/a331acc5-865a-4eb2-ab52-68364af9726c => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:37:50.961148 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5e40dece-0786-4afc-b586-850dff2d23e0 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:50.961681 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5e40dece-0786-4afc-b586-850dff2d23e0 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:50.969189 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e40dece-0786-4afc-b586-850dff2d23e0 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:50.969632 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e40dece-0786-4afc-b586-850dff2d23e0 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:50.970397 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e40dece-0786-4afc-b586-850dff2d23e0 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:50.970825 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5e40dece-0786-4afc-b586-850dff2d23e0 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:51.135022 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-5e40dece-0786-4afc-b586-850dff2d23e0 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:51.142965 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5e40dece-0786-4afc-b586-850dff2d23e0 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1757 microversion: 2.1 time: 0.185574 Feb 21 01:37:51.143527 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 353/724] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:50 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:51.792889 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6a6466a9-db45-46fd-9397-fe6b396f96c1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:37:51.798923 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a6466a9-db45-46fd-9397-fe6b396f96c1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:51.799372 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6a6466a9-db45-46fd-9397-fe6b396f96c1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:51.821164 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6a6466a9-db45-46fd-9397-fe6b396f96c1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Going to try to stop instance {{(pid=123541) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 21 01:37:51.971431 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6a6466a9-db45-46fd-9397-fe6b396f96c1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "POST /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd/action" status: 202 len: 0 microversion: 2.1 time: 0.182884 Feb 21 01:37:51.972042 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 372/725] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Feb 21 01:37:51 2022] POST /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:37:51.980697 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2506dd58-6caf-4775-bdcd-10abbb35e701 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:51.984844 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2506dd58-6caf-4775-bdcd-10abbb35e701 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:51.987478 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2506dd58-6caf-4775-bdcd-10abbb35e701 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:51.987929 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2506dd58-6caf-4775-bdcd-10abbb35e701 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:51.988754 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2506dd58-6caf-4775-bdcd-10abbb35e701 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:51.989241 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2506dd58-6caf-4775-bdcd-10abbb35e701 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:52.119771 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-2506dd58-6caf-4775-bdcd-10abbb35e701 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:52.126981 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2506dd58-6caf-4775-bdcd-10abbb35e701 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1676 microversion: 2.1 time: 0.150177 Feb 21 01:37:52.127538 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 354/726] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:51 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:52.160884 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-01639870-8886-43c9-a1fa-fcd62829ac00 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:52.161587 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-01639870-8886-43c9-a1fa-fcd62829ac00 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:52.167510 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01639870-8886-43c9-a1fa-fcd62829ac00 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:52.167963 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01639870-8886-43c9-a1fa-fcd62829ac00 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:52.168771 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01639870-8886-43c9-a1fa-fcd62829ac00 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:52.169205 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-01639870-8886-43c9-a1fa-fcd62829ac00 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:52.309229 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-01639870-8886-43c9-a1fa-fcd62829ac00 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:52.317489 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-01639870-8886-43c9-a1fa-fcd62829ac00 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1757 microversion: 2.1 time: 0.160027 Feb 21 01:37:52.318063 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 373/727] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:52 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:53.145226 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-625f1757-ace0-4ef8-959f-d00a759da3db tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:53.145844 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-625f1757-ace0-4ef8-959f-d00a759da3db tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:53.152029 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-625f1757-ace0-4ef8-959f-d00a759da3db tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:53.152501 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-625f1757-ace0-4ef8-959f-d00a759da3db tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:53.153275 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-625f1757-ace0-4ef8-959f-d00a759da3db tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:53.153710 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-625f1757-ace0-4ef8-959f-d00a759da3db tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:53.284169 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-625f1757-ace0-4ef8-959f-d00a759da3db tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:53.291975 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-625f1757-ace0-4ef8-959f-d00a759da3db tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1676 microversion: 2.1 time: 0.150482 Feb 21 01:37:53.292569 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 355/728] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:53 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:53.333634 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d1aa36ea-6b4d-49e8-b39a-7632fe6e605a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:53.334251 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d1aa36ea-6b4d-49e8-b39a-7632fe6e605a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:53.340369 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1aa36ea-6b4d-49e8-b39a-7632fe6e605a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:53.340849 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1aa36ea-6b4d-49e8-b39a-7632fe6e605a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:53.341620 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1aa36ea-6b4d-49e8-b39a-7632fe6e605a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:53.342057 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1aa36ea-6b4d-49e8-b39a-7632fe6e605a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:53.481652 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-d1aa36ea-6b4d-49e8-b39a-7632fe6e605a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:53.489330 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d1aa36ea-6b4d-49e8-b39a-7632fe6e605a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1757 microversion: 2.1 time: 0.159310 Feb 21 01:37:53.489910 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 374/729] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:53 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:54.309692 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-46a3f2ad-47d7-446b-8401-83c43e5dd85d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:54.310290 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-46a3f2ad-47d7-446b-8401-83c43e5dd85d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:54.316496 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46a3f2ad-47d7-446b-8401-83c43e5dd85d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:54.317561 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46a3f2ad-47d7-446b-8401-83c43e5dd85d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:54.318323 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46a3f2ad-47d7-446b-8401-83c43e5dd85d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:54.318749 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46a3f2ad-47d7-446b-8401-83c43e5dd85d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:54.451299 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-46a3f2ad-47d7-446b-8401-83c43e5dd85d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:54.458398 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-46a3f2ad-47d7-446b-8401-83c43e5dd85d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1676 microversion: 2.1 time: 0.152373 Feb 21 01:37:54.458957 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 356/730] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:54 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:54.506928 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-65f9622c-b232-4396-a86c-9da251388600 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:54.507537 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-65f9622c-b232-4396-a86c-9da251388600 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:54.514137 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65f9622c-b232-4396-a86c-9da251388600 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:54.514581 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65f9622c-b232-4396-a86c-9da251388600 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:54.515352 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65f9622c-b232-4396-a86c-9da251388600 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:54.515780 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-65f9622c-b232-4396-a86c-9da251388600 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:54.666157 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-65f9622c-b232-4396-a86c-9da251388600 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:54.674047 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-65f9622c-b232-4396-a86c-9da251388600 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1757 microversion: 2.1 time: 0.171343 Feb 21 01:37:54.674836 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 375/731] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:54 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:55.475161 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ead02db7-44b0-42f8-9c2d-a5fdb65552a5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:55.475791 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ead02db7-44b0-42f8-9c2d-a5fdb65552a5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:55.482053 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ead02db7-44b0-42f8-9c2d-a5fdb65552a5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:55.482496 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ead02db7-44b0-42f8-9c2d-a5fdb65552a5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:55.483267 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ead02db7-44b0-42f8-9c2d-a5fdb65552a5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:55.483726 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ead02db7-44b0-42f8-9c2d-a5fdb65552a5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:55.619434 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ead02db7-44b0-42f8-9c2d-a5fdb65552a5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:55.626799 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ead02db7-44b0-42f8-9c2d-a5fdb65552a5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1676 microversion: 2.1 time: 0.155275 Feb 21 01:37:55.627360 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 357/732] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:55 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:55.690644 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-92c0bd43-36ea-4045-8533-974005ca4eab tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:55.691257 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-92c0bd43-36ea-4045-8533-974005ca4eab tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:55.698081 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92c0bd43-36ea-4045-8533-974005ca4eab tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:55.698532 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92c0bd43-36ea-4045-8533-974005ca4eab tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:55.699307 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92c0bd43-36ea-4045-8533-974005ca4eab tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:55.699744 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-92c0bd43-36ea-4045-8533-974005ca4eab tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:55.845349 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-92c0bd43-36ea-4045-8533-974005ca4eab tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:55.853032 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-92c0bd43-36ea-4045-8533-974005ca4eab tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1757 microversion: 2.1 time: 0.165988 Feb 21 01:37:55.853637 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 376/733] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:55 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:56.644693 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7bb2e0db-a5ad-4726-8b8b-f72ef33ef663 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:56.645872 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7bb2e0db-a5ad-4726-8b8b-f72ef33ef663 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:56.652080 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7bb2e0db-a5ad-4726-8b8b-f72ef33ef663 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:56.652564 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7bb2e0db-a5ad-4726-8b8b-f72ef33ef663 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:56.653339 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7bb2e0db-a5ad-4726-8b8b-f72ef33ef663 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:56.653773 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7bb2e0db-a5ad-4726-8b8b-f72ef33ef663 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:56.782506 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-7bb2e0db-a5ad-4726-8b8b-f72ef33ef663 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:56.790335 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7bb2e0db-a5ad-4726-8b8b-f72ef33ef663 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1676 microversion: 2.1 time: 0.149769 Feb 21 01:37:56.790908 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 358/734] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:56 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:56.869738 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-41bf71d6-33a4-4e52-b5fd-fe1fd7589a26 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:56.870282 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-41bf71d6-33a4-4e52-b5fd-fe1fd7589a26 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:56.876387 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41bf71d6-33a4-4e52-b5fd-fe1fd7589a26 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:56.876876 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41bf71d6-33a4-4e52-b5fd-fe1fd7589a26 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:56.877650 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41bf71d6-33a4-4e52-b5fd-fe1fd7589a26 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:56.878087 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-41bf71d6-33a4-4e52-b5fd-fe1fd7589a26 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:57.023707 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-41bf71d6-33a4-4e52-b5fd-fe1fd7589a26 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:57.031451 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-41bf71d6-33a4-4e52-b5fd-fe1fd7589a26 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1757 microversion: 2.1 time: 0.165417 Feb 21 01:37:57.032003 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 377/735] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:56 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:57.807399 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fa13d6b3-57e1-4309-872b-ced2d4fac3d8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:57.808013 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fa13d6b3-57e1-4309-872b-ced2d4fac3d8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:57.814271 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa13d6b3-57e1-4309-872b-ced2d4fac3d8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:57.814722 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa13d6b3-57e1-4309-872b-ced2d4fac3d8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:57.815496 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa13d6b3-57e1-4309-872b-ced2d4fac3d8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:57.815932 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fa13d6b3-57e1-4309-872b-ced2d4fac3d8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:57.944152 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-fa13d6b3-57e1-4309-872b-ced2d4fac3d8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:57.951418 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fa13d6b3-57e1-4309-872b-ced2d4fac3d8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1676 microversion: 2.1 time: 0.147692 Feb 21 01:37:57.953651 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 359/736] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:57 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:58.048264 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bb92fa35-14b1-4c10-9726-f5a81092a3ea tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:58.048970 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bb92fa35-14b1-4c10-9726-f5a81092a3ea tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:58.055106 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb92fa35-14b1-4c10-9726-f5a81092a3ea tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:58.056852 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb92fa35-14b1-4c10-9726-f5a81092a3ea tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:58.056852 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb92fa35-14b1-4c10-9726-f5a81092a3ea tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:58.056852 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bb92fa35-14b1-4c10-9726-f5a81092a3ea tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:58.201421 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-bb92fa35-14b1-4c10-9726-f5a81092a3ea tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:58.209976 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bb92fa35-14b1-4c10-9726-f5a81092a3ea tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1757 microversion: 2.1 time: 0.165420 Feb 21 01:37:58.210543 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 378/737] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:58 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:58.969017 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4cd1fb1f-6984-4e52-9d6e-607849eef6cf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:58.969645 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4cd1fb1f-6984-4e52-9d6e-607849eef6cf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:58.975690 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cd1fb1f-6984-4e52-9d6e-607849eef6cf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:58.976145 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cd1fb1f-6984-4e52-9d6e-607849eef6cf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:58.976947 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cd1fb1f-6984-4e52-9d6e-607849eef6cf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:58.977459 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cd1fb1f-6984-4e52-9d6e-607849eef6cf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:59.108744 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-4cd1fb1f-6984-4e52-9d6e-607849eef6cf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:59.117984 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4cd1fb1f-6984-4e52-9d6e-607849eef6cf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1676 microversion: 2.1 time: 0.152721 Feb 21 01:37:59.118560 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 360/738] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:58 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:37:59.226524 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0d13df59-ecd2-4e2f-bb67-e37b6c5aa45a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:37:59.227042 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0d13df59-ecd2-4e2f-bb67-e37b6c5aa45a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:37:59.233228 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d13df59-ecd2-4e2f-bb67-e37b6c5aa45a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:59.233673 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d13df59-ecd2-4e2f-bb67-e37b6c5aa45a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:59.234433 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d13df59-ecd2-4e2f-bb67-e37b6c5aa45a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:37:59.234860 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0d13df59-ecd2-4e2f-bb67-e37b6c5aa45a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:37:59.376362 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-0d13df59-ecd2-4e2f-bb67-e37b6c5aa45a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:37:59.384167 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0d13df59-ecd2-4e2f-bb67-e37b6c5aa45a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1757 microversion: 2.1 time: 0.161851 Feb 21 01:37:59.385024 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 379/739] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:37:59 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:00.135222 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-186aed7f-c060-4c06-bc4e-fa0fa86263df tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:00.135868 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-186aed7f-c060-4c06-bc4e-fa0fa86263df tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:00.142183 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-186aed7f-c060-4c06-bc4e-fa0fa86263df tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:00.142645 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-186aed7f-c060-4c06-bc4e-fa0fa86263df tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:00.143424 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-186aed7f-c060-4c06-bc4e-fa0fa86263df tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:00.143858 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-186aed7f-c060-4c06-bc4e-fa0fa86263df tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:00.278654 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-186aed7f-c060-4c06-bc4e-fa0fa86263df tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:00.286571 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-186aed7f-c060-4c06-bc4e-fa0fa86263df tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1676 microversion: 2.1 time: 0.155299 Feb 21 01:38:00.287142 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 361/740] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:00 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:00.401650 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-99ac8a46-960d-461f-846f-49cc9da5aa6a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:00.402198 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-99ac8a46-960d-461f-846f-49cc9da5aa6a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:00.408576 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99ac8a46-960d-461f-846f-49cc9da5aa6a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:00.409109 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99ac8a46-960d-461f-846f-49cc9da5aa6a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:00.409861 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99ac8a46-960d-461f-846f-49cc9da5aa6a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:00.410293 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-99ac8a46-960d-461f-846f-49cc9da5aa6a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:00.553721 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-99ac8a46-960d-461f-846f-49cc9da5aa6a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:00.561511 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-99ac8a46-960d-461f-846f-49cc9da5aa6a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1757 microversion: 2.1 time: 0.163600 Feb 21 01:38:00.562080 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 380/741] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:00 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:01.303956 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-29ac703b-62cb-476c-99c0-dc2b20270f53 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:01.304631 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-29ac703b-62cb-476c-99c0-dc2b20270f53 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:01.311064 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29ac703b-62cb-476c-99c0-dc2b20270f53 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:01.311516 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29ac703b-62cb-476c-99c0-dc2b20270f53 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:01.312309 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29ac703b-62cb-476c-99c0-dc2b20270f53 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:01.312782 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-29ac703b-62cb-476c-99c0-dc2b20270f53 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:01.459419 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-29ac703b-62cb-476c-99c0-dc2b20270f53 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:01.465743 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-29ac703b-62cb-476c-99c0-dc2b20270f53 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1676 microversion: 2.1 time: 0.166005 Feb 21 01:38:01.466306 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 362/742] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:01 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:01.579037 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-34dc8d84-2ce2-46d6-99e2-de79edc86c35 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:01.579648 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-34dc8d84-2ce2-46d6-99e2-de79edc86c35 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:01.585912 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34dc8d84-2ce2-46d6-99e2-de79edc86c35 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:01.586358 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34dc8d84-2ce2-46d6-99e2-de79edc86c35 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:01.587127 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34dc8d84-2ce2-46d6-99e2-de79edc86c35 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:01.587559 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-34dc8d84-2ce2-46d6-99e2-de79edc86c35 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:01.736290 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-34dc8d84-2ce2-46d6-99e2-de79edc86c35 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:01.747842 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-34dc8d84-2ce2-46d6-99e2-de79edc86c35 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1757 microversion: 2.1 time: 0.172281 Feb 21 01:38:01.748561 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 381/743] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:01 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:02.483381 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-84e0caad-3f41-4d50-9750-5d9d5e22fa38 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:02.489083 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-84e0caad-3f41-4d50-9750-5d9d5e22fa38 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:02.490879 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84e0caad-3f41-4d50-9750-5d9d5e22fa38 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:02.491328 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84e0caad-3f41-4d50-9750-5d9d5e22fa38 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:02.492129 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84e0caad-3f41-4d50-9750-5d9d5e22fa38 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:02.492590 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84e0caad-3f41-4d50-9750-5d9d5e22fa38 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:02.626681 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-84e0caad-3f41-4d50-9750-5d9d5e22fa38 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:02.634867 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-84e0caad-3f41-4d50-9750-5d9d5e22fa38 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1676 microversion: 2.1 time: 0.155015 Feb 21 01:38:02.635432 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 363/744] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:02 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:02.766946 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5b2ea539-7d16-4a57-8e64-232f3c536334 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:02.767477 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5b2ea539-7d16-4a57-8e64-232f3c536334 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:02.773743 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b2ea539-7d16-4a57-8e64-232f3c536334 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:02.774190 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b2ea539-7d16-4a57-8e64-232f3c536334 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:02.780832 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b2ea539-7d16-4a57-8e64-232f3c536334 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:02.780832 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5b2ea539-7d16-4a57-8e64-232f3c536334 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:02.916023 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-5b2ea539-7d16-4a57-8e64-232f3c536334 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:02.923635 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5b2ea539-7d16-4a57-8e64-232f3c536334 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1757 microversion: 2.1 time: 0.160410 Feb 21 01:38:02.924195 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 382/745] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:02 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:03.651455 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f68b9787-9b49-4a39-8349-1da097d8b7af tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:03.652081 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f68b9787-9b49-4a39-8349-1da097d8b7af tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:03.658048 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f68b9787-9b49-4a39-8349-1da097d8b7af tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:03.658498 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f68b9787-9b49-4a39-8349-1da097d8b7af tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:03.659273 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f68b9787-9b49-4a39-8349-1da097d8b7af tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:03.659707 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f68b9787-9b49-4a39-8349-1da097d8b7af tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:03.791707 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-f68b9787-9b49-4a39-8349-1da097d8b7af tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:03.799714 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f68b9787-9b49-4a39-8349-1da097d8b7af tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1676 microversion: 2.1 time: 0.151891 Feb 21 01:38:03.800280 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 364/746] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:03 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:03.941229 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-553d9115-552b-4a5c-a4cf-5d25d3889acf tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:03.941841 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-553d9115-552b-4a5c-a4cf-5d25d3889acf tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:03.948093 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-553d9115-552b-4a5c-a4cf-5d25d3889acf tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:03.948585 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-553d9115-552b-4a5c-a4cf-5d25d3889acf tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:03.949358 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-553d9115-552b-4a5c-a4cf-5d25d3889acf tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:03.949824 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-553d9115-552b-4a5c-a4cf-5d25d3889acf tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:04.094527 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-553d9115-552b-4a5c-a4cf-5d25d3889acf tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:04.102896 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-553d9115-552b-4a5c-a4cf-5d25d3889acf tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1757 microversion: 2.1 time: 0.165338 Feb 21 01:38:04.103461 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 383/747] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:03 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:04.816957 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0c1cbb22-4134-4993-b562-a49e0c3c6d1b tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:04.817561 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0c1cbb22-4134-4993-b562-a49e0c3c6d1b tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:04.824089 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c1cbb22-4134-4993-b562-a49e0c3c6d1b tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:04.824606 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c1cbb22-4134-4993-b562-a49e0c3c6d1b tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:04.825385 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c1cbb22-4134-4993-b562-a49e0c3c6d1b tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:04.825821 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0c1cbb22-4134-4993-b562-a49e0c3c6d1b tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:04.953910 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-0c1cbb22-4134-4993-b562-a49e0c3c6d1b tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:04.961776 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0c1cbb22-4134-4993-b562-a49e0c3c6d1b tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1676 microversion: 2.1 time: 0.148582 Feb 21 01:38:04.962346 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 365/748] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:04 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:05.120009 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8eee7709-430c-4042-9ab4-659d73cbd145 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:05.120644 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8eee7709-430c-4042-9ab4-659d73cbd145 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:05.126802 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8eee7709-430c-4042-9ab4-659d73cbd145 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:05.127244 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8eee7709-430c-4042-9ab4-659d73cbd145 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:05.128001 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8eee7709-430c-4042-9ab4-659d73cbd145 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:05.128446 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8eee7709-430c-4042-9ab4-659d73cbd145 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:05.273455 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-8eee7709-430c-4042-9ab4-659d73cbd145 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:05.281138 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8eee7709-430c-4042-9ab4-659d73cbd145 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1757 microversion: 2.1 time: 0.164761 Feb 21 01:38:05.281709 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 384/749] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:05 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:05.978960 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-46f7ef8f-85e5-4d95-93fa-f512e2baa2d6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:05.979583 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-46f7ef8f-85e5-4d95-93fa-f512e2baa2d6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:05.986243 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46f7ef8f-85e5-4d95-93fa-f512e2baa2d6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:05.986690 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46f7ef8f-85e5-4d95-93fa-f512e2baa2d6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:05.987469 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46f7ef8f-85e5-4d95-93fa-f512e2baa2d6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:05.987905 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-46f7ef8f-85e5-4d95-93fa-f512e2baa2d6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:06.117703 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-46f7ef8f-85e5-4d95-93fa-f512e2baa2d6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:06.125070 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-46f7ef8f-85e5-4d95-93fa-f512e2baa2d6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1676 microversion: 2.1 time: 0.149664 Feb 21 01:38:06.125620 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 366/750] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:05 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:06.297785 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3782d88e-1cab-4e8e-aae7-dcaab0f4a65b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:06.298383 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3782d88e-1cab-4e8e-aae7-dcaab0f4a65b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:06.305146 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3782d88e-1cab-4e8e-aae7-dcaab0f4a65b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:06.305594 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3782d88e-1cab-4e8e-aae7-dcaab0f4a65b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:06.306364 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3782d88e-1cab-4e8e-aae7-dcaab0f4a65b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:06.306796 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3782d88e-1cab-4e8e-aae7-dcaab0f4a65b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:06.447061 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-3782d88e-1cab-4e8e-aae7-dcaab0f4a65b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:06.454798 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3782d88e-1cab-4e8e-aae7-dcaab0f4a65b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1757 microversion: 2.1 time: 0.160644 Feb 21 01:38:06.455364 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 385/751] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:06 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:07.142875 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c2ac5fda-cd2c-4735-af01-1b40fdb217f8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:07.143484 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c2ac5fda-cd2c-4735-af01-1b40fdb217f8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:07.150450 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2ac5fda-cd2c-4735-af01-1b40fdb217f8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:07.150894 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2ac5fda-cd2c-4735-af01-1b40fdb217f8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:07.151666 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2ac5fda-cd2c-4735-af01-1b40fdb217f8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:07.152098 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c2ac5fda-cd2c-4735-af01-1b40fdb217f8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:07.322504 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c2ac5fda-cd2c-4735-af01-1b40fdb217f8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:07.329701 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c2ac5fda-cd2c-4735-af01-1b40fdb217f8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1676 microversion: 2.1 time: 0.190465 Feb 21 01:38:07.330266 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 367/752] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:07 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1676 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:07.470947 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7bf1139b-5ec0-41a7-bb49-9640296d1c1a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:07.471547 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7bf1139b-5ec0-41a7-bb49-9640296d1c1a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:07.477265 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bf1139b-5ec0-41a7-bb49-9640296d1c1a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:07.477708 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bf1139b-5ec0-41a7-bb49-9640296d1c1a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:07.478476 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bf1139b-5ec0-41a7-bb49-9640296d1c1a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:07.478907 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7bf1139b-5ec0-41a7-bb49-9640296d1c1a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:07.634646 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-7bf1139b-5ec0-41a7-bb49-9640296d1c1a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:07.642461 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7bf1139b-5ec0-41a7-bb49-9640296d1c1a tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1757 microversion: 2.1 time: 0.175353 Feb 21 01:38:07.643027 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 386/753] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:07 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:08.347081 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-52bfb3ec-d961-4fd0-bb49-5df048898cef tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:08.347635 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-52bfb3ec-d961-4fd0-bb49-5df048898cef tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:08.353739 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52bfb3ec-d961-4fd0-bb49-5df048898cef tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:08.354177 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52bfb3ec-d961-4fd0-bb49-5df048898cef tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:08.354939 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52bfb3ec-d961-4fd0-bb49-5df048898cef tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:08.355365 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52bfb3ec-d961-4fd0-bb49-5df048898cef tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:08.486308 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-52bfb3ec-d961-4fd0-bb49-5df048898cef tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:08.495437 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-52bfb3ec-d961-4fd0-bb49-5df048898cef tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1676 microversion: 2.1 time: 0.151923 Feb 21 01:38:08.496261 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 368/754] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:08 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:08.659611 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5440c16c-5a47-4f71-861e-898f21e6df0c tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:08.660221 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5440c16c-5a47-4f71-861e-898f21e6df0c tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:08.666736 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5440c16c-5a47-4f71-861e-898f21e6df0c tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:08.667188 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5440c16c-5a47-4f71-861e-898f21e6df0c tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:08.667967 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5440c16c-5a47-4f71-861e-898f21e6df0c tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:08.668394 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5440c16c-5a47-4f71-861e-898f21e6df0c tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:08.817092 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-5440c16c-5a47-4f71-861e-898f21e6df0c tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:08.825097 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5440c16c-5a47-4f71-861e-898f21e6df0c tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1757 microversion: 2.1 time: 0.169158 Feb 21 01:38:08.825787 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 387/755] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:08 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:09.515810 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2b499c0a-3ae5-4a35-a3ef-7d86b5a22bf8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:09.516605 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2b499c0a-3ae5-4a35-a3ef-7d86b5a22bf8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:09.523100 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b499c0a-3ae5-4a35-a3ef-7d86b5a22bf8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:09.523626 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b499c0a-3ae5-4a35-a3ef-7d86b5a22bf8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:09.524411 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b499c0a-3ae5-4a35-a3ef-7d86b5a22bf8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:09.524871 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b499c0a-3ae5-4a35-a3ef-7d86b5a22bf8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:09.672008 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-2b499c0a-3ae5-4a35-a3ef-7d86b5a22bf8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:09.679687 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2b499c0a-3ae5-4a35-a3ef-7d86b5a22bf8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1676 microversion: 2.1 time: 0.167729 Feb 21 01:38:09.680259 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 369/756] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:09 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:09.842886 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-386451df-91ed-4012-9b2a-19fe5daf30df tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:09.843511 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-386451df-91ed-4012-9b2a-19fe5daf30df tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:09.849734 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-386451df-91ed-4012-9b2a-19fe5daf30df tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:09.850185 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-386451df-91ed-4012-9b2a-19fe5daf30df tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:09.850962 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-386451df-91ed-4012-9b2a-19fe5daf30df tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:09.851394 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-386451df-91ed-4012-9b2a-19fe5daf30df tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:09.995898 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-386451df-91ed-4012-9b2a-19fe5daf30df tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:10.003614 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-386451df-91ed-4012-9b2a-19fe5daf30df tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1757 microversion: 2.1 time: 0.164520 Feb 21 01:38:10.004786 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 388/757] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:09 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:10.698809 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ab6db304-6bc2-4c6c-8000-daf26de972b0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:10.699894 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ab6db304-6bc2-4c6c-8000-daf26de972b0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:10.706282 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab6db304-6bc2-4c6c-8000-daf26de972b0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:10.706749 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab6db304-6bc2-4c6c-8000-daf26de972b0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:10.708034 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab6db304-6bc2-4c6c-8000-daf26de972b0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:10.708494 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab6db304-6bc2-4c6c-8000-daf26de972b0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:10.844648 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ab6db304-6bc2-4c6c-8000-daf26de972b0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:10.851954 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ab6db304-6bc2-4c6c-8000-daf26de972b0 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1676 microversion: 2.1 time: 0.157760 Feb 21 01:38:10.852537 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 370/758] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:10 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:11.021614 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ba6f199d-203f-42cf-a483-03f97f35e6cd tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:11.022230 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ba6f199d-203f-42cf-a483-03f97f35e6cd tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:11.028410 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba6f199d-203f-42cf-a483-03f97f35e6cd tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:11.028906 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba6f199d-203f-42cf-a483-03f97f35e6cd tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:11.030794 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba6f199d-203f-42cf-a483-03f97f35e6cd tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:11.031316 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ba6f199d-203f-42cf-a483-03f97f35e6cd tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:11.178910 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-ba6f199d-203f-42cf-a483-03f97f35e6cd tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:11.186890 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ba6f199d-203f-42cf-a483-03f97f35e6cd tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1757 microversion: 2.1 time: 0.169404 Feb 21 01:38:11.187463 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 389/759] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:11 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:11.868994 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-052f070c-4665-487b-ba7f-74919b3a2acf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:11.869610 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-052f070c-4665-487b-ba7f-74919b3a2acf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:11.875843 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-052f070c-4665-487b-ba7f-74919b3a2acf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:11.876294 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-052f070c-4665-487b-ba7f-74919b3a2acf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:11.877161 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-052f070c-4665-487b-ba7f-74919b3a2acf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:11.877606 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-052f070c-4665-487b-ba7f-74919b3a2acf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:12.014329 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-052f070c-4665-487b-ba7f-74919b3a2acf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:12.021581 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-052f070c-4665-487b-ba7f-74919b3a2acf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1653 microversion: 2.1 time: 0.156217 Feb 21 01:38:12.022148 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 371/760] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:11 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1653 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:12.040922 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1176b965-1026-41cf-a12e-e27404a47832 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:38:12.047223 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1176b965-1026-41cf-a12e-e27404a47832 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:12.047673 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1176b965-1026-41cf-a12e-e27404a47832 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:12.069709 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1176b965-1026-41cf-a12e-e27404a47832 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Going to try to start instance {{(pid=123541) start /opt/stack/nova/nova/compute/api.py:2677}} Feb 21 01:38:12.203445 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7224e39e-f691-4e10-abe6-e6d8007c92eb tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:12.204163 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7224e39e-f691-4e10-abe6-e6d8007c92eb tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:12.210565 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7224e39e-f691-4e10-abe6-e6d8007c92eb tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:12.211012 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7224e39e-f691-4e10-abe6-e6d8007c92eb tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:12.211782 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7224e39e-f691-4e10-abe6-e6d8007c92eb tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:12.212209 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7224e39e-f691-4e10-abe6-e6d8007c92eb tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:12.259929 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1176b965-1026-41cf-a12e-e27404a47832 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "POST /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd/action" status: 202 len: 0 microversion: 2.1 time: 0.222146 Feb 21 01:38:12.260553 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 390/761] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Feb 21 01:38:12 2022] POST /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:38:12.269840 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-31e94d75-fe51-477c-8e53-ddf8b0b81cd2 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:12.270787 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-31e94d75-fe51-477c-8e53-ddf8b0b81cd2 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:12.278843 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31e94d75-fe51-477c-8e53-ddf8b0b81cd2 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:12.279324 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31e94d75-fe51-477c-8e53-ddf8b0b81cd2 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:12.280367 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31e94d75-fe51-477c-8e53-ddf8b0b81cd2 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:12.280823 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31e94d75-fe51-477c-8e53-ddf8b0b81cd2 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:12.395000 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-7224e39e-f691-4e10-abe6-e6d8007c92eb tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:12.404369 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7224e39e-f691-4e10-abe6-e6d8007c92eb tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1760 microversion: 2.1 time: 0.204364 Feb 21 01:38:12.404982 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 372/762] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:12 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1760 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:38:12.464789 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-31e94d75-fe51-477c-8e53-ddf8b0b81cd2 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:12.474438 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-31e94d75-fe51-477c-8e53-ddf8b0b81cd2 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1662 microversion: 2.1 time: 0.209345 Feb 21 01:38:12.475596 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 391/763] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:12 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1662 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:38:13.492765 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f6de67c0-37e9-4692-8d40-92e8fc218bbc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:13.493397 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f6de67c0-37e9-4692-8d40-92e8fc218bbc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:13.502061 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6de67c0-37e9-4692-8d40-92e8fc218bbc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:13.502519 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6de67c0-37e9-4692-8d40-92e8fc218bbc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:13.503310 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6de67c0-37e9-4692-8d40-92e8fc218bbc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:13.503784 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6de67c0-37e9-4692-8d40-92e8fc218bbc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:13.735701 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-f6de67c0-37e9-4692-8d40-92e8fc218bbc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:13.743518 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f6de67c0-37e9-4692-8d40-92e8fc218bbc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1662 microversion: 2.1 time: 0.254334 Feb 21 01:38:13.744156 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 373/764] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:13 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1662 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:14.761485 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9fa12504-68a4-4c36-a940-4112133df9dc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:14.762101 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9fa12504-68a4-4c36-a940-4112133df9dc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:14.768403 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9fa12504-68a4-4c36-a940-4112133df9dc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:14.768916 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9fa12504-68a4-4c36-a940-4112133df9dc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:14.769690 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9fa12504-68a4-4c36-a940-4112133df9dc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:14.770128 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9fa12504-68a4-4c36-a940-4112133df9dc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:14.900621 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-9fa12504-68a4-4c36-a940-4112133df9dc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:14.907752 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9fa12504-68a4-4c36-a940-4112133df9dc tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1666 microversion: 2.1 time: 0.150318 Feb 21 01:38:14.908331 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 392/765] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:38:14 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1666 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:53.926031 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:38:53.926665 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: Mon Feb 21 01:38:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:38:54.674749 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f6397354-b09c-40bd-8bf0-fa18521b6ca7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:54.675245 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f6397354-b09c-40bd-8bf0-fa18521b6ca7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:54.681514 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6397354-b09c-40bd-8bf0-fa18521b6ca7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:54.682602 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6397354-b09c-40bd-8bf0-fa18521b6ca7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:54.683381 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6397354-b09c-40bd-8bf0-fa18521b6ca7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:54.683813 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f6397354-b09c-40bd-8bf0-fa18521b6ca7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:54.712732 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f6397354-b09c-40bd-8bf0-fa18521b6ca7 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d/os-volume_attachments/05901c1a-86bf-4865-ac93-8c23d63a7a2c" status: 200 len: 194 microversion: 2.20 time: 0.041765 Feb 21 01:38:54.713317 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 374/766] 10.222.0.90 () {60 vars in 1453 bytes} [Mon Feb 21 01:38:54 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d/os-volume_attachments/05901c1a-86bf-4865-ac93-8c23d63a7a2c => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:38:54.773191 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-814cdd99-a1af-4dd9-8c11-4b36dc04e2a6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:54.773705 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-814cdd99-a1af-4dd9-8c11-4b36dc04e2a6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:54.780119 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-814cdd99-a1af-4dd9-8c11-4b36dc04e2a6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:54.780563 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-814cdd99-a1af-4dd9-8c11-4b36dc04e2a6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:54.781321 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-814cdd99-a1af-4dd9-8c11-4b36dc04e2a6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:54.781747 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-814cdd99-a1af-4dd9-8c11-4b36dc04e2a6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:54.862710 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-814cdd99-a1af-4dd9-8c11-4b36dc04e2a6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lazy-loading 'services' on Instance uuid 962b0526-5a3e-4044-a74f-34fe41f7717d {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:38:55.000797 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-814cdd99-a1af-4dd9-8c11-4b36dc04e2a6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "DELETE /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d/os-volume_attachments/05901c1a-86bf-4865-ac93-8c23d63a7a2c" status: 202 len: 0 microversion: 2.20 time: 0.231095 Feb 21 01:38:55.001500 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 393/767] 10.222.0.90 () {60 vars in 1456 bytes} [Mon Feb 21 01:38:54 2022] DELETE /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d/os-volume_attachments/05901c1a-86bf-4865-ac93-8c23d63a7a2c => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:38:55.011186 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d133b11c-0470-4890-8b53-696022ded52b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:55.012287 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d133b11c-0470-4890-8b53-696022ded52b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:55.018227 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d133b11c-0470-4890-8b53-696022ded52b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:55.018678 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d133b11c-0470-4890-8b53-696022ded52b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:55.019458 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d133b11c-0470-4890-8b53-696022ded52b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:55.019896 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d133b11c-0470-4890-8b53-696022ded52b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:55.050277 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d133b11c-0470-4890-8b53-696022ded52b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044183 Feb 21 01:38:55.050760 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 375/768] 10.222.0.90 () {60 vars in 1342 bytes} [Mon Feb 21 01:38:55 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:38:56.063530 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-48c1417a-0034-4352-b8fc-b15250924d1a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:56.064610 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-48c1417a-0034-4352-b8fc-b15250924d1a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:56.070562 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48c1417a-0034-4352-b8fc-b15250924d1a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:56.079682 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48c1417a-0034-4352-b8fc-b15250924d1a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:56.079682 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48c1417a-0034-4352-b8fc-b15250924d1a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:56.079682 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48c1417a-0034-4352-b8fc-b15250924d1a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:56.100610 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-48c1417a-0034-4352-b8fc-b15250924d1a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041688 Feb 21 01:38:56.101152 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 394/769] 10.222.0.90 () {60 vars in 1342 bytes} [Mon Feb 21 01:38:56 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:38:57.116519 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8192a9e4-e7b9-48ba-a3f8-e80f6c098b87 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:57.116519 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8192a9e4-e7b9-48ba-a3f8-e80f6c098b87 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:57.118790 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8192a9e4-e7b9-48ba-a3f8-e80f6c098b87 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:57.120028 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8192a9e4-e7b9-48ba-a3f8-e80f6c098b87 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:57.120833 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8192a9e4-e7b9-48ba-a3f8-e80f6c098b87 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:57.121260 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8192a9e4-e7b9-48ba-a3f8-e80f6c098b87 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:57.151586 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8192a9e4-e7b9-48ba-a3f8-e80f6c098b87 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043642 Feb 21 01:38:57.152150 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 376/770] 10.222.0.90 () {60 vars in 1342 bytes} [Mon Feb 21 01:38:57 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:38:57.206075 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8072f666-79f8-4223-8856-dcfc0333198a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:57.206593 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8072f666-79f8-4223-8856-dcfc0333198a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:57.213267 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8072f666-79f8-4223-8856-dcfc0333198a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:57.213730 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8072f666-79f8-4223-8856-dcfc0333198a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:57.214508 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8072f666-79f8-4223-8856-dcfc0333198a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:57.214943 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8072f666-79f8-4223-8856-dcfc0333198a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:57.239217 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8072f666-79f8-4223-8856-dcfc0333198a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:38:57.465015 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8072f666-79f8-4223-8856-dcfc0333198a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "DELETE /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 204 len: 0 microversion: 2.20 time: 0.262392 Feb 21 01:38:57.465596 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 395/771] 10.222.0.90 () {60 vars in 1279 bytes} [Mon Feb 21 01:38:57 2022] DELETE /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 21 01:38:57.473786 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e552f02c-56c6-4ad5-b775-f2c8717563ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:57.474387 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e552f02c-56c6-4ad5-b775-f2c8717563ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:57.480137 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e552f02c-56c6-4ad5-b775-f2c8717563ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:57.480694 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e552f02c-56c6-4ad5-b775-f2c8717563ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:57.481438 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e552f02c-56c6-4ad5-b775-f2c8717563ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:57.481863 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e552f02c-56c6-4ad5-b775-f2c8717563ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:57.620317 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-e552f02c-56c6-4ad5-b775-f2c8717563ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:57.628145 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-e552f02c-56c6-4ad5-b775-f2c8717563ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:57.629700 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-e552f02c-56c6-4ad5-b775-f2c8717563ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:57.630852 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e552f02c-56c6-4ad5-b775-f2c8717563ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1722 microversion: 2.20 time: 0.160797 Feb 21 01:38:57.631411 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 377/772] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:38:57 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:38:58.649951 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1ebf0433-ae55-4381-8445-b354bf379df0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:58.650682 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1ebf0433-ae55-4381-8445-b354bf379df0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:58.659710 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ebf0433-ae55-4381-8445-b354bf379df0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:58.660542 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ebf0433-ae55-4381-8445-b354bf379df0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:58.661346 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ebf0433-ae55-4381-8445-b354bf379df0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:58.661789 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ebf0433-ae55-4381-8445-b354bf379df0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:58.797338 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1ebf0433-ae55-4381-8445-b354bf379df0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:58.805016 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1ebf0433-ae55-4381-8445-b354bf379df0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:58.807021 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1ebf0433-ae55-4381-8445-b354bf379df0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:38:58.808167 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1ebf0433-ae55-4381-8445-b354bf379df0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1722 microversion: 2.20 time: 0.162284 Feb 21 01:38:58.808759 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 396/773] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:38:58 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:38:59.825819 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f9b6730e-b19e-4183-addb-0f574794e782 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:38:59.826426 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f9b6730e-b19e-4183-addb-0f574794e782 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:38:59.833021 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9b6730e-b19e-4183-addb-0f574794e782 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:59.833469 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9b6730e-b19e-4183-addb-0f574794e782 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:38:59.834273 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9b6730e-b19e-4183-addb-0f574794e782 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:38:59.834711 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f9b6730e-b19e-4183-addb-0f574794e782 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:00.211551 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-f9b6730e-b19e-4183-addb-0f574794e782 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:00.220041 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-f9b6730e-b19e-4183-addb-0f574794e782 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:00.221603 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-f9b6730e-b19e-4183-addb-0f574794e782 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:00.225485 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f9b6730e-b19e-4183-addb-0f574794e782 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1722 microversion: 2.20 time: 0.400688 Feb 21 01:39:00.225485 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 378/774] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:38:59 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1722 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:39:00.698196 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-f57fe67d-6db4-4cec-aa00-5a30d22e94c9 req-1725ec22-f72e-4ae7-9bda-cbb4d3e5b756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "962b0526-5a3e-4044-a74f-34fe41f7717d", "name": "network-vif-deleted", "tag": "d7edbb2e-2fa7-4065-ba3b-97a6d16d31e7"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:39:00.699883 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:39:00.699883 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:39:00.708142 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f57fe67d-6db4-4cec-aa00-5a30d22e94c9 req-1725ec22-f72e-4ae7-9bda-cbb4d3e5b756 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:00.709064 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f57fe67d-6db4-4cec-aa00-5a30d22e94c9 req-1725ec22-f72e-4ae7-9bda-cbb4d3e5b756 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:00.720275 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-f57fe67d-6db4-4cec-aa00-5a30d22e94c9 req-1725ec22-f72e-4ae7-9bda-cbb4d3e5b756 service nova] Creating event network-vif-deleted:d7edbb2e-2fa7-4065-ba3b-97a6d16d31e7 for instance 962b0526-5a3e-4044-a74f-34fe41f7717d on hv-cinder-81322 Feb 21 01:39:00.725673 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-f57fe67d-6db4-4cec-aa00-5a30d22e94c9 req-1725ec22-f72e-4ae7-9bda-cbb4d3e5b756 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031404 Feb 21 01:39:00.726442 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 397/775] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:39:01.246524 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7c924a46-9d43-4c0a-85ba-4a9af1e1d1d5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:01.247174 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7c924a46-9d43-4c0a-85ba-4a9af1e1d1d5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:01.254841 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c924a46-9d43-4c0a-85ba-4a9af1e1d1d5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:01.255290 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c924a46-9d43-4c0a-85ba-4a9af1e1d1d5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:01.256112 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c924a46-9d43-4c0a-85ba-4a9af1e1d1d5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:01.256604 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c924a46-9d43-4c0a-85ba-4a9af1e1d1d5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:01.292128 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c924a46-9d43-4c0a-85ba-4a9af1e1d1d5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:01.292814 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7c924a46-9d43-4c0a-85ba-4a9af1e1d1d5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:01.293377 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-7c924a46-9d43-4c0a-85ba-4a9af1e1d1d5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lazy-loading 'fault' on Instance uuid 962b0526-5a3e-4044-a74f-34fe41f7717d {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:39:01.332597 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-7c924a46-9d43-4c0a-85ba-4a9af1e1d1d5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:01.341275 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-7c924a46-9d43-4c0a-85ba-4a9af1e1d1d5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:01.342852 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-7c924a46-9d43-4c0a-85ba-4a9af1e1d1d5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:01.344060 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7c924a46-9d43-4c0a-85ba-4a9af1e1d1d5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 200 len: 1370 microversion: 2.20 time: 0.104799 Feb 21 01:39:01.344628 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 379/776] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:39:01 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 1370 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:39:02.362959 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2bf18100-6825-42e8-a795-80bd7575be39 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:02.363657 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2bf18100-6825-42e8-a795-80bd7575be39 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:02.369660 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bf18100-6825-42e8-a795-80bd7575be39 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:02.370102 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bf18100-6825-42e8-a795-80bd7575be39 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:02.370859 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bf18100-6825-42e8-a795-80bd7575be39 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:02.371280 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2bf18100-6825-42e8-a795-80bd7575be39 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:02.384007 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-2bf18100-6825-42e8-a795-80bd7575be39 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] HTTP exception thrown: Instance 962b0526-5a3e-4044-a74f-34fe41f7717d could not be found. Feb 21 01:39:02.384616 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2bf18100-6825-42e8-a795-80bd7575be39 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Returning 404 to user: Instance 962b0526-5a3e-4044-a74f-34fe41f7717d could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:39:02.385779 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2bf18100-6825-42e8-a795-80bd7575be39 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 404 len: 111 microversion: 2.20 time: 0.027412 Feb 21 01:39:02.386315 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 398/777] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:39:02 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:39:02.394312 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5cec119e-0325-4741-bf8d-f9e206923373 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '.version_select at 0x7f4075b9e280>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:02.505519 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5cec119e-0325-4741-bf8d-f9e206923373 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-273732818" status: 204 len: 0 microversion: 2.20 time: 0.114692 Feb 21 01:39:02.506102 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 380/778] 10.222.0.90 () {60 vars in 1258 bytes} [Mon Feb 21 01:39:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-273732818 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 21 01:39:03.310598 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9dc65ee2-474d-4d02-af87-8f0640b50a68 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Action: 'create', calling method: .version_select at 0x7f4075cc1820>, body: {"keypair": {"name": "tempest-keypair-1844298681"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:39:03.326467 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-9dc65ee2-474d-4d02-af87-8f0640b50a68 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Getting quotas for project d3acaa73503748ac9764a7eca8943882. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:39:03.330690 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-9dc65ee2-474d-4d02-af87-8f0640b50a68 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Getting quotas for user ab38a084fbb643298d38c4cd8dcf87cd and project d3acaa73503748ac9764a7eca8943882. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:39:03.709346 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-9dc65ee2-474d-4d02-af87-8f0640b50a68 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Getting quotas for project d3acaa73503748ac9764a7eca8943882. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:39:03.713084 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-9dc65ee2-474d-4d02-af87-8f0640b50a68 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Getting quotas for user ab38a084fbb643298d38c4cd8dcf87cd and project d3acaa73503748ac9764a7eca8943882. Resources: {'key_pairs'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:39:03.726058 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9dc65ee2-474d-4d02-af87-8f0640b50a68 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.419647 Feb 21 01:39:03.726878 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 399/779] 10.222.0.90 () {62 vars in 1198 bytes} [Mon Feb 21 01:39:03 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 421 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 21 01:39:05.795265 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0e085f88-217b-4e1d-8eb9-ba891a4fb788 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2077846076", "imageRef": "35936a71-5ec3-4154-b01a-f2dafd8c0364", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ed6465a-9bc3-4ebd-8f4a-72b7db58dd61"}], "security_groups": [{"name": "tempest-securitygroup--1064722737"}], "key_name": "tempest-keypair-1844298681", "user_data": "}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:39:06.041983 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-0e085f88-217b-4e1d-8eb9-ba891a4fb788 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] validate_networks() for [('6ed6465a-9bc3-4ebd-8f4a-72b7db58dd61', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:39:06.475671 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-0e085f88-217b-4e1d-8eb9-ba891a4fb788 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:39:06.476088 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-0e085f88-217b-4e1d-8eb9-ba891a4fb788 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:39:06.476662 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-0e085f88-217b-4e1d-8eb9-ba891a4fb788 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:39:06.477001 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-0e085f88-217b-4e1d-8eb9-ba891a4fb788 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:39:06.477408 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-0e085f88-217b-4e1d-8eb9-ba891a4fb788 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:39:06.486292 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e085f88-217b-4e1d-8eb9-ba891a4fb788 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:06.486737 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e085f88-217b-4e1d-8eb9-ba891a4fb788 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:06.487541 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e085f88-217b-4e1d-8eb9-ba891a4fb788 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:06.487971 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0e085f88-217b-4e1d-8eb9-ba891a4fb788 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:06.504298 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-0e085f88-217b-4e1d-8eb9-ba891a4fb788 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Getting quotas for project d3acaa73503748ac9764a7eca8943882. Resources: {'ram', 'cores', 'instances'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:39:06.508146 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-0e085f88-217b-4e1d-8eb9-ba891a4fb788 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Getting quotas for user ab38a084fbb643298d38c4cd8dcf87cd and project d3acaa73503748ac9764a7eca8943882. Resources: {'ram', 'cores', 'instances'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:39:06.520064 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0e085f88-217b-4e1d-8eb9-ba891a4fb788 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:39:06.522414 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0e085f88-217b-4e1d-8eb9-ba891a4fb788 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35936a71-5ec3-4154-b01a-f2dafd8c0364',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:39:06.649518 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0e085f88-217b-4e1d-8eb9-ba891a4fb788 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.858836 Feb 21 01:39:06.650184 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 381/780] 10.222.0.90 () {62 vars in 1187 bytes} [Mon Feb 21 01:39:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 21 01:39:06.660301 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-905606a1-3018-4fdf-b194-e25f5b3a5c5f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:06.660945 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-905606a1-3018-4fdf-b194-e25f5b3a5c5f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:06.715618 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-905606a1-3018-4fdf-b194-e25f5b3a5c5f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:06.725329 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-905606a1-3018-4fdf-b194-e25f5b3a5c5f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:06.725329 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-905606a1-3018-4fdf-b194-e25f5b3a5c5f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:06.725565 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-905606a1-3018-4fdf-b194-e25f5b3a5c5f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1282 microversion: 2.20 time: 0.069349 Feb 21 01:39:06.726088 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 400/781] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:39:06 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1282 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:39:07.744064 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7e85f6f9-3f98-4d3a-9e8d-735ed2ed7ff6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:07.744733 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7e85f6f9-3f98-4d3a-9e8d-735ed2ed7ff6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:07.750631 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e85f6f9-3f98-4d3a-9e8d-735ed2ed7ff6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:07.751089 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e85f6f9-3f98-4d3a-9e8d-735ed2ed7ff6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:07.751855 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e85f6f9-3f98-4d3a-9e8d-735ed2ed7ff6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:07.752295 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7e85f6f9-3f98-4d3a-9e8d-735ed2ed7ff6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:07.812121 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-7e85f6f9-3f98-4d3a-9e8d-735ed2ed7ff6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:07.819764 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-7e85f6f9-3f98-4d3a-9e8d-735ed2ed7ff6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:07.821298 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-7e85f6f9-3f98-4d3a-9e8d-735ed2ed7ff6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:07.823058 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7e85f6f9-3f98-4d3a-9e8d-735ed2ed7ff6 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1334 microversion: 2.20 time: 0.083653 Feb 21 01:39:07.823607 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 382/782] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:39:07 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1334 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:39:08.841404 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2f865e01-858c-49d9-9ecd-f7ced2eb344e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:08.842021 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2f865e01-858c-49d9-9ecd-f7ced2eb344e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:08.847959 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f865e01-858c-49d9-9ecd-f7ced2eb344e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:08.848407 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f865e01-858c-49d9-9ecd-f7ced2eb344e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:08.849198 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f865e01-858c-49d9-9ecd-f7ced2eb344e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:08.849629 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2f865e01-858c-49d9-9ecd-f7ced2eb344e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:08.919085 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2f865e01-858c-49d9-9ecd-f7ced2eb344e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:08.926904 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2f865e01-858c-49d9-9ecd-f7ced2eb344e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:08.928370 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2f865e01-858c-49d9-9ecd-f7ced2eb344e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:08.929480 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2f865e01-858c-49d9-9ecd-f7ced2eb344e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1340 microversion: 2.20 time: 0.092057 Feb 21 01:39:08.930027 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 401/783] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:39:08 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1340 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:39:09.952328 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e97eee0b-6025-449e-b3fd-0ba5eb4fe933 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:09.952903 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e97eee0b-6025-449e-b3fd-0ba5eb4fe933 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:09.959435 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e97eee0b-6025-449e-b3fd-0ba5eb4fe933 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:09.959885 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e97eee0b-6025-449e-b3fd-0ba5eb4fe933 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:09.960689 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e97eee0b-6025-449e-b3fd-0ba5eb4fe933 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:09.961129 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e97eee0b-6025-449e-b3fd-0ba5eb4fe933 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:10.091079 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-e97eee0b-6025-449e-b3fd-0ba5eb4fe933 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:10.098705 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-e97eee0b-6025-449e-b3fd-0ba5eb4fe933 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:10.100203 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-e97eee0b-6025-449e-b3fd-0ba5eb4fe933 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:10.101324 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e97eee0b-6025-449e-b3fd-0ba5eb4fe933 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1408 microversion: 2.20 time: 0.152802 Feb 21 01:39:10.101874 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 383/784] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:39:09 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:39:11.119853 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6c0ae8b4-8a47-4973-81e7-c97d61d24386 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:11.120491 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6c0ae8b4-8a47-4973-81e7-c97d61d24386 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:11.127195 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c0ae8b4-8a47-4973-81e7-c97d61d24386 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:11.127649 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c0ae8b4-8a47-4973-81e7-c97d61d24386 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:11.128467 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c0ae8b4-8a47-4973-81e7-c97d61d24386 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:11.129679 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6c0ae8b4-8a47-4973-81e7-c97d61d24386 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:11.550109 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-6c0ae8b4-8a47-4973-81e7-c97d61d24386 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:11.558023 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-6c0ae8b4-8a47-4973-81e7-c97d61d24386 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:11.559515 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-6c0ae8b4-8a47-4973-81e7-c97d61d24386 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:11.560645 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6c0ae8b4-8a47-4973-81e7-c97d61d24386 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1408 microversion: 2.20 time: 0.445172 Feb 21 01:39:11.561201 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 402/785] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:39:11 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1408 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:39:11.656006 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-3d0a2d27-39df-479a-881b-462488d25886 req-caaadc17-9902-4f6a-8f9f-137cf8ee9995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e49ba09-7813-4190-b34c-c2a6fc9c49bb", "tag": "f62f5ef9-41f3-4a8a-abf2-f89200d260f6"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:39:11.657769 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:39:11.657769 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:39:11.665310 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3d0a2d27-39df-479a-881b-462488d25886 req-caaadc17-9902-4f6a-8f9f-137cf8ee9995 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:11.665958 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-3d0a2d27-39df-479a-881b-462488d25886 req-caaadc17-9902-4f6a-8f9f-137cf8ee9995 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:11.678943 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-3d0a2d27-39df-479a-881b-462488d25886 req-caaadc17-9902-4f6a-8f9f-137cf8ee9995 service nova] Creating event network-changed:f62f5ef9-41f3-4a8a-abf2-f89200d260f6 for instance 6e49ba09-7813-4190-b34c-c2a6fc9c49bb on hv-cinder-81322 Feb 21 01:39:11.684400 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-3d0a2d27-39df-479a-881b-462488d25886 req-caaadc17-9902-4f6a-8f9f-137cf8ee9995 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032886 Feb 21 01:39:11.685110 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 384/786] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:39:12.577500 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c24302c4-5269-4337-b0fa-da2e48454215 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:12.578098 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c24302c4-5269-4337-b0fa-da2e48454215 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:12.584497 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c24302c4-5269-4337-b0fa-da2e48454215 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:12.584958 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c24302c4-5269-4337-b0fa-da2e48454215 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:12.585802 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c24302c4-5269-4337-b0fa-da2e48454215 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:12.586338 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c24302c4-5269-4337-b0fa-da2e48454215 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:12.894978 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-c24302c4-5269-4337-b0fa-da2e48454215 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:12.903380 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-c24302c4-5269-4337-b0fa-da2e48454215 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:12.905058 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-c24302c4-5269-4337-b0fa-da2e48454215 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:12.906170 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c24302c4-5269-4337-b0fa-da2e48454215 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1408 microversion: 2.20 time: 0.332406 Feb 21 01:39:12.906730 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 403/787] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:39:12 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1408 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:39:13.924565 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-16232fed-b5ee-4017-b56f-9d560b890f23 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:13.925288 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-16232fed-b5ee-4017-b56f-9d560b890f23 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:13.931830 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16232fed-b5ee-4017-b56f-9d560b890f23 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:13.932274 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16232fed-b5ee-4017-b56f-9d560b890f23 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:13.933070 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16232fed-b5ee-4017-b56f-9d560b890f23 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:13.933498 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-16232fed-b5ee-4017-b56f-9d560b890f23 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:14.062704 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-16232fed-b5ee-4017-b56f-9d560b890f23 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:14.070375 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-16232fed-b5ee-4017-b56f-9d560b890f23 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:14.071862 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-16232fed-b5ee-4017-b56f-9d560b890f23 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:14.073000 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-16232fed-b5ee-4017-b56f-9d560b890f23 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1408 microversion: 2.20 time: 0.153033 Feb 21 01:39:14.073558 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 385/788] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:39:13 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:39:15.090616 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8034f8da-e206-4a08-89af-a6beca59aad1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:15.091223 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8034f8da-e206-4a08-89af-a6beca59aad1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:15.097561 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8034f8da-e206-4a08-89af-a6beca59aad1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:15.098041 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8034f8da-e206-4a08-89af-a6beca59aad1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:15.098814 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8034f8da-e206-4a08-89af-a6beca59aad1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:15.099249 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8034f8da-e206-4a08-89af-a6beca59aad1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:15.230325 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-8034f8da-e206-4a08-89af-a6beca59aad1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:15.238028 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-8034f8da-e206-4a08-89af-a6beca59aad1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:15.239482 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-8034f8da-e206-4a08-89af-a6beca59aad1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:15.240648 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8034f8da-e206-4a08-89af-a6beca59aad1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1408 microversion: 2.20 time: 0.153750 Feb 21 01:39:15.241208 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 404/789] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:39:15 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:39:16.258567 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b6fd5397-cf22-4768-93c3-16dc9c7c3082 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:16.259202 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b6fd5397-cf22-4768-93c3-16dc9c7c3082 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:16.265760 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6fd5397-cf22-4768-93c3-16dc9c7c3082 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:16.266208 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6fd5397-cf22-4768-93c3-16dc9c7c3082 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:16.266978 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6fd5397-cf22-4768-93c3-16dc9c7c3082 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:16.267410 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b6fd5397-cf22-4768-93c3-16dc9c7c3082 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:16.434661 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-b6fd5397-cf22-4768-93c3-16dc9c7c3082 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:16.445243 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-b6fd5397-cf22-4768-93c3-16dc9c7c3082 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:16.447394 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-b6fd5397-cf22-4768-93c3-16dc9c7c3082 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:16.448899 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b6fd5397-cf22-4768-93c3-16dc9c7c3082 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1408 microversion: 2.20 time: 0.194006 Feb 21 01:39:16.449542 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 386/790] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:39:16 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1408 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:39:17.470881 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1a59b46d-4f37-448e-b1cf-6644a30ed480 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:17.471470 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1a59b46d-4f37-448e-b1cf-6644a30ed480 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:17.477765 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a59b46d-4f37-448e-b1cf-6644a30ed480 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:17.478218 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a59b46d-4f37-448e-b1cf-6644a30ed480 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:17.478994 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a59b46d-4f37-448e-b1cf-6644a30ed480 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:17.480023 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a59b46d-4f37-448e-b1cf-6644a30ed480 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:17.614442 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1a59b46d-4f37-448e-b1cf-6644a30ed480 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:17.622540 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1a59b46d-4f37-448e-b1cf-6644a30ed480 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:17.624046 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1a59b46d-4f37-448e-b1cf-6644a30ed480 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:17.625176 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1a59b46d-4f37-448e-b1cf-6644a30ed480 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1408 microversion: 2.20 time: 0.158006 Feb 21 01:39:17.625756 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 405/791] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:39:17 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:39:18.643127 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-59868e42-2360-4c13-a7d8-c28560946123 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:18.643739 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-59868e42-2360-4c13-a7d8-c28560946123 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:18.649991 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59868e42-2360-4c13-a7d8-c28560946123 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:18.650440 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59868e42-2360-4c13-a7d8-c28560946123 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:18.651880 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59868e42-2360-4c13-a7d8-c28560946123 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:18.652317 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-59868e42-2360-4c13-a7d8-c28560946123 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:18.805458 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-59868e42-2360-4c13-a7d8-c28560946123 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:18.813598 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-59868e42-2360-4c13-a7d8-c28560946123 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:18.815094 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-59868e42-2360-4c13-a7d8-c28560946123 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:18.816191 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-59868e42-2360-4c13-a7d8-c28560946123 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1408 microversion: 2.20 time: 0.176801 Feb 21 01:39:18.816786 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 387/792] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:39:18 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:39:19.834529 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-918225d4-40b9-4b66-96b0-3af3a7649ce4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:19.835138 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-918225d4-40b9-4b66-96b0-3af3a7649ce4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:19.841528 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-918225d4-40b9-4b66-96b0-3af3a7649ce4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:19.841980 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-918225d4-40b9-4b66-96b0-3af3a7649ce4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:19.842761 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-918225d4-40b9-4b66-96b0-3af3a7649ce4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:19.843227 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-918225d4-40b9-4b66-96b0-3af3a7649ce4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:19.978167 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-918225d4-40b9-4b66-96b0-3af3a7649ce4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:19.986516 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-918225d4-40b9-4b66-96b0-3af3a7649ce4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:19.988002 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-918225d4-40b9-4b66-96b0-3af3a7649ce4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:19.989270 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-918225d4-40b9-4b66-96b0-3af3a7649ce4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1408 microversion: 2.20 time: 0.158518 Feb 21 01:39:19.999880 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 406/793] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:39:19 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:39:21.006863 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b4887618-3702-4f08-8c35-5f35d8d3bf5c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:21.007831 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b4887618-3702-4f08-8c35-5f35d8d3bf5c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:21.014473 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4887618-3702-4f08-8c35-5f35d8d3bf5c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:21.014913 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4887618-3702-4f08-8c35-5f35d8d3bf5c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:21.015940 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4887618-3702-4f08-8c35-5f35d8d3bf5c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:21.016497 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b4887618-3702-4f08-8c35-5f35d8d3bf5c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:21.091953 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-b434424a-4a7c-4868-bd8b-b3922da3fc7e req-7806a7fe-b836-4233-b111-c9f0a0a24ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e49ba09-7813-4190-b34c-c2a6fc9c49bb", "name": "network-vif-plugged", "status": "completed", "tag": "f62f5ef9-41f3-4a8a-abf2-f89200d260f6"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:39:21.093532 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:39:21.093532 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:39:21.100281 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b434424a-4a7c-4868-bd8b-b3922da3fc7e req-7806a7fe-b836-4233-b111-c9f0a0a24ad1 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:21.100759 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b434424a-4a7c-4868-bd8b-b3922da3fc7e req-7806a7fe-b836-4233-b111-c9f0a0a24ad1 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:21.111984 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-b434424a-4a7c-4868-bd8b-b3922da3fc7e req-7806a7fe-b836-4233-b111-c9f0a0a24ad1 service nova] Creating event network-vif-plugged:f62f5ef9-41f3-4a8a-abf2-f89200d260f6 for instance 6e49ba09-7813-4190-b34c-c2a6fc9c49bb on hv-cinder-81322 Feb 21 01:39:21.116974 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-b434424a-4a7c-4868-bd8b-b3922da3fc7e req-7806a7fe-b836-4233-b111-c9f0a0a24ad1 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222846 Feb 21 01:39:21.117578 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 388/794] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:39:21.158213 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b4887618-3702-4f08-8c35-5f35d8d3bf5c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:21.166011 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b4887618-3702-4f08-8c35-5f35d8d3bf5c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:21.168128 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b4887618-3702-4f08-8c35-5f35d8d3bf5c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:21.169254 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b4887618-3702-4f08-8c35-5f35d8d3bf5c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1408 microversion: 2.20 time: 0.166100 Feb 21 01:39:21.170040 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 407/795] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:39:21 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:39:22.187767 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6dae8530-58f2-4d2b-9b4b-2ef949f5dd99 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:22.188512 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6dae8530-58f2-4d2b-9b4b-2ef949f5dd99 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:22.194545 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6dae8530-58f2-4d2b-9b4b-2ef949f5dd99 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:22.194993 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6dae8530-58f2-4d2b-9b4b-2ef949f5dd99 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:22.195760 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6dae8530-58f2-4d2b-9b4b-2ef949f5dd99 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:22.196191 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6dae8530-58f2-4d2b-9b4b-2ef949f5dd99 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:22.326709 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-6dae8530-58f2-4d2b-9b4b-2ef949f5dd99 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:22.334237 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-6dae8530-58f2-4d2b-9b4b-2ef949f5dd99 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:22.335720 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-6dae8530-58f2-4d2b-9b4b-2ef949f5dd99 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:22.336830 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6dae8530-58f2-4d2b-9b4b-2ef949f5dd99 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1408 microversion: 2.20 time: 0.153641 Feb 21 01:39:22.337381 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 389/796] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:39:22 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:39:23.355878 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-39f6287c-340b-478f-a66e-26fc665fcc2f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:23.356521 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-39f6287c-340b-478f-a66e-26fc665fcc2f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:23.362717 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39f6287c-340b-478f-a66e-26fc665fcc2f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:23.363164 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39f6287c-340b-478f-a66e-26fc665fcc2f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:23.363938 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39f6287c-340b-478f-a66e-26fc665fcc2f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:23.364375 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-39f6287c-340b-478f-a66e-26fc665fcc2f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:23.492314 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-39f6287c-340b-478f-a66e-26fc665fcc2f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:23.499931 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-39f6287c-340b-478f-a66e-26fc665fcc2f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:23.501465 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-39f6287c-340b-478f-a66e-26fc665fcc2f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:23.502612 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-39f6287c-340b-478f-a66e-26fc665fcc2f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1600 microversion: 2.20 time: 0.151165 Feb 21 01:39:23.503170 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 408/797] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:39:23 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:39:23.527641 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d799ae11-4e48-49f8-80d0-f70893ec218d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:23.528160 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d799ae11-4e48-49f8-80d0-f70893ec218d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:23.534365 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d799ae11-4e48-49f8-80d0-f70893ec218d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:23.534811 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d799ae11-4e48-49f8-80d0-f70893ec218d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:23.535583 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d799ae11-4e48-49f8-80d0-f70893ec218d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:23.536013 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d799ae11-4e48-49f8-80d0-f70893ec218d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:23.621642 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d799ae11-4e48-49f8-80d0-f70893ec218d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.098283 Feb 21 01:39:23.622432 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 390/798] 10.222.0.90 () {60 vars in 1315 bytes} [Mon Feb 21 01:39:23 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:39:24.830816 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9426e5c6-c4e4-4e1c-a4f5-e60692c8208e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:24.831342 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9426e5c6-c4e4-4e1c-a4f5-e60692c8208e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:24.833207 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-a8de9998-9345-405e-8e07-3c1c0fb5214f req-b62c8aa6-6c87-4893-849c-1fc89ff1f0c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e49ba09-7813-4190-b34c-c2a6fc9c49bb", "tag": "f62f5ef9-41f3-4a8a-abf2-f89200d260f6"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:39:24.834948 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:39:24.834948 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:39:24.837855 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9426e5c6-c4e4-4e1c-a4f5-e60692c8208e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:24.838307 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9426e5c6-c4e4-4e1c-a4f5-e60692c8208e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:24.839327 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9426e5c6-c4e4-4e1c-a4f5-e60692c8208e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:24.839760 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9426e5c6-c4e4-4e1c-a4f5-e60692c8208e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:24.842224 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a8de9998-9345-405e-8e07-3c1c0fb5214f req-b62c8aa6-6c87-4893-849c-1fc89ff1f0c0 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:24.842899 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a8de9998-9345-405e-8e07-3c1c0fb5214f req-b62c8aa6-6c87-4893-849c-1fc89ff1f0c0 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:24.854612 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-a8de9998-9345-405e-8e07-3c1c0fb5214f req-b62c8aa6-6c87-4893-849c-1fc89ff1f0c0 service nova] Creating event network-changed:f62f5ef9-41f3-4a8a-abf2-f89200d260f6 for instance 6e49ba09-7813-4190-b34c-c2a6fc9c49bb on hv-cinder-81322 Feb 21 01:39:24.859923 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-a8de9998-9345-405e-8e07-3c1c0fb5214f req-b62c8aa6-6c87-4893-849c-1fc89ff1f0c0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030760 Feb 21 01:39:24.864855 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 391/799] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:39:24.868466 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9426e5c6-c4e4-4e1c-a4f5-e60692c8208e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb/ips" status: 200 len: 112 microversion: 2.20 time: 0.041695 Feb 21 01:39:24.869028 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 409/800] 10.222.0.90 () {60 vars in 1288 bytes} [Mon Feb 21 01:39:24 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb/ips => generated 112 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:39:31.083873 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ad4f9409-e741-47f6-9b17-a4a2c1a51501 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:39:31.084413 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ad4f9409-e741-47f6-9b17-a4a2c1a51501 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:31.091287 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad4f9409-e741-47f6-9b17-a4a2c1a51501 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:31.091766 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad4f9409-e741-47f6-9b17-a4a2c1a51501 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:31.092581 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad4f9409-e741-47f6-9b17-a4a2c1a51501 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:31.093025 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad4f9409-e741-47f6-9b17-a4a2c1a51501 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:31.115057 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-ad4f9409-e741-47f6-9b17-a4a2c1a51501 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lazy-loading 'flavor' on Instance uuid 3bfdab9d-ba0f-4923-ad4e-40ef23db9338 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:39:31.370908 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ad4f9409-e741-47f6-9b17-a4a2c1a51501 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "POST /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338/action" status: 202 len: 0 microversion: 2.1 time: 0.291635 Feb 21 01:39:31.375876 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 392/801] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Feb 21 01:39:31 2022] POST /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 21 01:39:31.379303 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-adb680bf-1ddc-45f7-af38-adbce7c7d192 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:31.379925 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-adb680bf-1ddc-45f7-af38-adbce7c7d192 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:31.386669 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-adb680bf-1ddc-45f7-af38-adbce7c7d192 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:31.387118 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-adb680bf-1ddc-45f7-af38-adbce7c7d192 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:31.387899 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-adb680bf-1ddc-45f7-af38-adbce7c7d192 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:31.388340 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-adb680bf-1ddc-45f7-af38-adbce7c7d192 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:31.523780 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-adb680bf-1ddc-45f7-af38-adbce7c7d192 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:31.531088 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-adb680bf-1ddc-45f7-af38-adbce7c7d192 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1568 microversion: 2.1 time: 0.155379 Feb 21 01:39:31.531646 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 410/802] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:31 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:32.549892 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c64e95fc-7446-494b-95fd-d04aa4e5fdc0 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:32.550586 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c64e95fc-7446-494b-95fd-d04aa4e5fdc0 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:32.556578 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c64e95fc-7446-494b-95fd-d04aa4e5fdc0 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:32.557019 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c64e95fc-7446-494b-95fd-d04aa4e5fdc0 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:32.557781 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c64e95fc-7446-494b-95fd-d04aa4e5fdc0 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:32.558857 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c64e95fc-7446-494b-95fd-d04aa4e5fdc0 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:32.691407 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c64e95fc-7446-494b-95fd-d04aa4e5fdc0 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:32.698985 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c64e95fc-7446-494b-95fd-d04aa4e5fdc0 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1568 microversion: 2.1 time: 0.153251 Feb 21 01:39:32.699548 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 393/803] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:32 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:33.037238 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-11efca7f-05c0-400c-a9f1-a1e69e7c78ca tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1083368726"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:39:33.037833 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-11efca7f-05c0-400c-a9f1-a1e69e7c78ca tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:33.044913 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11efca7f-05c0-400c-a9f1-a1e69e7c78ca tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:33.045364 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11efca7f-05c0-400c-a9f1-a1e69e7c78ca tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:33.046134 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11efca7f-05c0-400c-a9f1-a1e69e7c78ca tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:33.046568 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-11efca7f-05c0-400c-a9f1-a1e69e7c78ca tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:33.180168 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.network.security_group_api [None req-11efca7f-05c0-400c-a9f1-a1e69e7c78ca tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Removing security group 9746bf9d-4fdc-43f3-8953-2b70074ef734 from port 3c272f96-f321-4ccf-a91e-d7d0afd792b2 Feb 21 01:39:33.558737 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-11efca7f-05c0-400c-a9f1-a1e69e7c78ca tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "POST /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04/action" status: 202 len: 0 microversion: 2.1 time: 0.525192 Feb 21 01:39:33.559847 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 411/804] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Feb 21 01:39:33 2022] POST /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 21 01:39:33.567254 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-e42eb7e7-1fe5-41a8-b7fa-5d04aa5f745d req-8e5dd288-2333-4f41-b775-2dc2d134c670 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b613c437-8337-4ce8-82d9-843cd6ccbc04", "tag": "3c272f96-f321-4ccf-a91e-d7d0afd792b2"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:39:33.574259 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:39:33.574259 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:39:33.578626 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e42eb7e7-1fe5-41a8-b7fa-5d04aa5f745d req-8e5dd288-2333-4f41-b775-2dc2d134c670 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:33.579077 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-e42eb7e7-1fe5-41a8-b7fa-5d04aa5f745d req-8e5dd288-2333-4f41-b775-2dc2d134c670 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:33.590891 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-e42eb7e7-1fe5-41a8-b7fa-5d04aa5f745d req-8e5dd288-2333-4f41-b775-2dc2d134c670 service nova] Creating event network-changed:3c272f96-f321-4ccf-a91e-d7d0afd792b2 for instance b613c437-8337-4ce8-82d9-843cd6ccbc04 on hv-cinder-81322 Feb 21 01:39:33.616576 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-e42eb7e7-1fe5-41a8-b7fa-5d04aa5f745d req-8e5dd288-2333-4f41-b775-2dc2d134c670 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053310 Feb 21 01:39:33.617507 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 394/805] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:39:33.716100 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-95132f21-5402-4a97-8db3-30fffe02c9b9 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:33.716924 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-95132f21-5402-4a97-8db3-30fffe02c9b9 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:33.729325 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95132f21-5402-4a97-8db3-30fffe02c9b9 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:33.731180 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95132f21-5402-4a97-8db3-30fffe02c9b9 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:33.738559 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95132f21-5402-4a97-8db3-30fffe02c9b9 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:33.740080 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-95132f21-5402-4a97-8db3-30fffe02c9b9 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:34.002869 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-95132f21-5402-4a97-8db3-30fffe02c9b9 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:34.013830 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-95132f21-5402-4a97-8db3-30fffe02c9b9 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1568 microversion: 2.1 time: 0.301980 Feb 21 01:39:34.014421 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 412/806] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:33 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1568 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:35.034038 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3526897d-182a-4a4e-93b4-226cf9bf6b97 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:35.034889 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3526897d-182a-4a4e-93b4-226cf9bf6b97 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:35.045029 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3526897d-182a-4a4e-93b4-226cf9bf6b97 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:35.045789 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3526897d-182a-4a4e-93b4-226cf9bf6b97 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:35.046816 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3526897d-182a-4a4e-93b4-226cf9bf6b97 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:35.047518 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3526897d-182a-4a4e-93b4-226cf9bf6b97 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:35.057993 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-77429324-ec36-42ac-80d6-1a8f2991b1b0 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:35.058494 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-77429324-ec36-42ac-80d6-1a8f2991b1b0 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:35.065509 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77429324-ec36-42ac-80d6-1a8f2991b1b0 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:35.065968 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77429324-ec36-42ac-80d6-1a8f2991b1b0 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:35.066758 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77429324-ec36-42ac-80d6-1a8f2991b1b0 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:35.067198 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-77429324-ec36-42ac-80d6-1a8f2991b1b0 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:35.147188 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-77429324-ec36-42ac-80d6-1a8f2991b1b0 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lazy-loading 'services' on Instance uuid b613c437-8337-4ce8-82d9-843cd6ccbc04 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:39:35.197991 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-3526897d-182a-4a4e-93b4-226cf9bf6b97 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:35.205913 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3526897d-182a-4a4e-93b4-226cf9bf6b97 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1568 microversion: 2.1 time: 0.178724 Feb 21 01:39:35.206496 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 395/807] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:35 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:35.278573 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-12df5756-85cd-487b-a351-0c40b2a8f844 req-8f2a2c52-b537-4a3c-be9a-b76af9d7c20a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b613c437-8337-4ce8-82d9-843cd6ccbc04", "tag": "3c272f96-f321-4ccf-a91e-d7d0afd792b2"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:39:35.278573 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:39:35.278573 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:39:35.285204 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-12df5756-85cd-487b-a351-0c40b2a8f844 req-8f2a2c52-b537-4a3c-be9a-b76af9d7c20a service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:35.285769 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-12df5756-85cd-487b-a351-0c40b2a8f844 req-8f2a2c52-b537-4a3c-be9a-b76af9d7c20a service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:35.297524 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-12df5756-85cd-487b-a351-0c40b2a8f844 req-8f2a2c52-b537-4a3c-be9a-b76af9d7c20a service nova] Creating event network-changed:3c272f96-f321-4ccf-a91e-d7d0afd792b2 for instance b613c437-8337-4ce8-82d9-843cd6ccbc04 on hv-cinder-81322 Feb 21 01:39:35.302657 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-12df5756-85cd-487b-a351-0c40b2a8f844 req-8f2a2c52-b537-4a3c-be9a-b76af9d7c20a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095037 Feb 21 01:39:35.307170 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 396/808] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:39:35.355074 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-77429324-ec36-42ac-80d6-1a8f2991b1b0 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "DELETE /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04/os-volume_attachments/f1a53b8e-96e6-4d25-876b-5a68332eb2a3" status: 202 len: 0 microversion: 2.1 time: 0.300858 Feb 21 01:39:35.356058 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 413/809] 10.222.0.90 () {58 vars in 1415 bytes} [Mon Feb 21 01:39:35 2022] DELETE /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04/os-volume_attachments/f1a53b8e-96e6-4d25-876b-5a68332eb2a3 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:39:35.364746 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f0936f85-ab86-446f-9c98-d60664fd2517 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:35.366148 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f0936f85-ab86-446f-9c98-d60664fd2517 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:35.375099 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0936f85-ab86-446f-9c98-d60664fd2517 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:35.375099 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0936f85-ab86-446f-9c98-d60664fd2517 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:35.376057 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0936f85-ab86-446f-9c98-d60664fd2517 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:35.376738 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f0936f85-ab86-446f-9c98-d60664fd2517 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:35.408731 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f0936f85-ab86-446f-9c98-d60664fd2517 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048082 Feb 21 01:39:35.409592 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 397/810] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:39:35 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:39:36.223920 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8c88dc7b-0dac-4f0b-99d6-fd2a5a245fb5 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:36.224716 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8c88dc7b-0dac-4f0b-99d6-fd2a5a245fb5 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:36.231532 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c88dc7b-0dac-4f0b-99d6-fd2a5a245fb5 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:36.232063 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c88dc7b-0dac-4f0b-99d6-fd2a5a245fb5 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:36.232965 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c88dc7b-0dac-4f0b-99d6-fd2a5a245fb5 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:36.233479 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8c88dc7b-0dac-4f0b-99d6-fd2a5a245fb5 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:36.369657 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-8c88dc7b-0dac-4f0b-99d6-fd2a5a245fb5 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:36.377494 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8c88dc7b-0dac-4f0b-99d6-fd2a5a245fb5 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1568 microversion: 2.1 time: 0.157968 Feb 21 01:39:36.378069 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 414/811] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:36 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:36.421320 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-944ad797-bf7e-4548-af2e-9515834eec6b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:36.422219 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-944ad797-bf7e-4548-af2e-9515834eec6b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:36.427933 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-944ad797-bf7e-4548-af2e-9515834eec6b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:36.430752 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-944ad797-bf7e-4548-af2e-9515834eec6b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:36.430752 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-944ad797-bf7e-4548-af2e-9515834eec6b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:36.430752 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-944ad797-bf7e-4548-af2e-9515834eec6b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:36.457616 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-944ad797-bf7e-4548-af2e-9515834eec6b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040603 Feb 21 01:39:36.458165 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 398/812] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:39:36 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 21 01:39:36.468678 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-91dd62a9-cd4b-4c5f-94d1-4f5b9d9d0b82 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:36.470985 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-91dd62a9-cd4b-4c5f-94d1-4f5b9d9d0b82 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:36.475837 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91dd62a9-cd4b-4c5f-94d1-4f5b9d9d0b82 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:36.476297 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91dd62a9-cd4b-4c5f-94d1-4f5b9d9d0b82 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:36.477112 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91dd62a9-cd4b-4c5f-94d1-4f5b9d9d0b82 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:36.477550 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-91dd62a9-cd4b-4c5f-94d1-4f5b9d9d0b82 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:36.548543 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-91dd62a9-cd4b-4c5f-94d1-4f5b9d9d0b82 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] HTTP exception thrown: Instance b613c437-8337-4ce8-82d9-843cd6ccbc04 is not attached to volume f1a53b8e-96e6-4d25-876b-5a68332eb2a3 Feb 21 01:39:36.549172 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-91dd62a9-cd4b-4c5f-94d1-4f5b9d9d0b82 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Returning 404 to user: Instance b613c437-8337-4ce8-82d9-843cd6ccbc04 is not attached to volume f1a53b8e-96e6-4d25-876b-5a68332eb2a3 {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:39:36.550065 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-91dd62a9-cd4b-4c5f-94d1-4f5b9d9d0b82 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "DELETE /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04/os-volume_attachments/f1a53b8e-96e6-4d25-876b-5a68332eb2a3" status: 404 len: 154 microversion: 2.1 time: 0.085964 Feb 21 01:39:36.550634 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 415/813] 10.222.0.90 () {58 vars in 1415 bytes} [Mon Feb 21 01:39:36 2022] DELETE /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04/os-volume_attachments/f1a53b8e-96e6-4d25-876b-5a68332eb2a3 => generated 154 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:39:37.394739 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4da4c4b4-ebf6-466b-8c55-b662a0f2555c tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:37.395348 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4da4c4b4-ebf6-466b-8c55-b662a0f2555c tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:37.401052 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4da4c4b4-ebf6-466b-8c55-b662a0f2555c tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:37.401999 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4da4c4b4-ebf6-466b-8c55-b662a0f2555c tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:37.402764 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4da4c4b4-ebf6-466b-8c55-b662a0f2555c tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:37.403189 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4da4c4b4-ebf6-466b-8c55-b662a0f2555c tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:37.541874 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-4da4c4b4-ebf6-466b-8c55-b662a0f2555c tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:37.549728 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4da4c4b4-ebf6-466b-8c55-b662a0f2555c tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1568 microversion: 2.1 time: 0.158650 Feb 21 01:39:37.550280 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 399/814] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:37 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:37.810761 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2e0f4775-e1bc-4f7c-a735-77350f31e7fe tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:37.811255 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2e0f4775-e1bc-4f7c-a735-77350f31e7fe tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:37.817206 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e0f4775-e1bc-4f7c-a735-77350f31e7fe tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:37.817667 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e0f4775-e1bc-4f7c-a735-77350f31e7fe tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:37.818433 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e0f4775-e1bc-4f7c-a735-77350f31e7fe tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:37.818873 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2e0f4775-e1bc-4f7c-a735-77350f31e7fe tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:37.843723 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2e0f4775-e1bc-4f7c-a735-77350f31e7fe tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:39:38.097948 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2e0f4775-e1bc-4f7c-a735-77350f31e7fe tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "DELETE /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 204 len: 0 microversion: 2.1 time: 0.290442 Feb 21 01:39:38.098445 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 416/815] 10.222.0.90 () {58 vars in 1238 bytes} [Mon Feb 21 01:39:37 2022] DELETE /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:39:38.106419 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-20e3defc-29d7-413b-ae05-23c542a5b6bf tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:38.107039 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-20e3defc-29d7-413b-ae05-23c542a5b6bf tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:38.112808 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20e3defc-29d7-413b-ae05-23c542a5b6bf tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:38.113268 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20e3defc-29d7-413b-ae05-23c542a5b6bf tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:38.114040 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20e3defc-29d7-413b-ae05-23c542a5b6bf tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:38.114477 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-20e3defc-29d7-413b-ae05-23c542a5b6bf tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:38.242888 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-20e3defc-29d7-413b-ae05-23c542a5b6bf tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:38.250633 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-20e3defc-29d7-413b-ae05-23c542a5b6bf tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1554 microversion: 2.1 time: 0.147899 Feb 21 01:39:38.251189 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 400/816] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:38 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:38.566379 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-951172b9-14aa-4401-8db8-c5ff5c5160fc tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:38.567002 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-951172b9-14aa-4401-8db8-c5ff5c5160fc tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:38.572974 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-951172b9-14aa-4401-8db8-c5ff5c5160fc tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:38.573420 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-951172b9-14aa-4401-8db8-c5ff5c5160fc tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:38.574196 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-951172b9-14aa-4401-8db8-c5ff5c5160fc tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:38.574627 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-951172b9-14aa-4401-8db8-c5ff5c5160fc tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:38.616364 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bae3d8c3-9d99-4b1c-82af-53cf450da985 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:38.617361 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bae3d8c3-9d99-4b1c-82af-53cf450da985 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:38.624140 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bae3d8c3-9d99-4b1c-82af-53cf450da985 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:38.624657 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bae3d8c3-9d99-4b1c-82af-53cf450da985 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:38.625382 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bae3d8c3-9d99-4b1c-82af-53cf450da985 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:38.625810 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bae3d8c3-9d99-4b1c-82af-53cf450da985 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:38.653987 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bae3d8c3-9d99-4b1c-82af-53cf450da985 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041278 Feb 21 01:39:38.654548 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 401/817] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:39:38 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 21 01:39:38.709721 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8f827813-f597-4658-aea5-ac7b8ebfd185 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:38.710236 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8f827813-f597-4658-aea5-ac7b8ebfd185 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:38.713966 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-951172b9-14aa-4401-8db8-c5ff5c5160fc tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:38.716042 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f827813-f597-4658-aea5-ac7b8ebfd185 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:38.716510 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f827813-f597-4658-aea5-ac7b8ebfd185 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:38.717282 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f827813-f597-4658-aea5-ac7b8ebfd185 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:38.717709 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8f827813-f597-4658-aea5-ac7b8ebfd185 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:38.721597 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-951172b9-14aa-4401-8db8-c5ff5c5160fc tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1568 microversion: 2.1 time: 0.159649 Feb 21 01:39:38.722249 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 417/818] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:38 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:38.742021 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8f827813-f597-4658-aea5-ac7b8ebfd185 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:39:38.949353 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8f827813-f597-4658-aea5-ac7b8ebfd185 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 204 len: 0 microversion: 2.1 time: 0.242992 Feb 21 01:39:38.950004 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 402/819] 10.222.0.90 () {58 vars in 1238 bytes} [Mon Feb 21 01:39:38 2022] DELETE /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 21 01:39:38.958044 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-408e1cae-bdc9-4bc8-a28c-8363eb0921a8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:38.962065 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-408e1cae-bdc9-4bc8-a28c-8363eb0921a8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:38.966189 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-408e1cae-bdc9-4bc8-a28c-8363eb0921a8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:38.966644 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-408e1cae-bdc9-4bc8-a28c-8363eb0921a8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:38.967428 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-408e1cae-bdc9-4bc8-a28c-8363eb0921a8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:38.967865 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-408e1cae-bdc9-4bc8-a28c-8363eb0921a8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:39.101436 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-408e1cae-bdc9-4bc8-a28c-8363eb0921a8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:39.109295 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-408e1cae-bdc9-4bc8-a28c-8363eb0921a8 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1672 microversion: 2.1 time: 0.155115 Feb 21 01:39:39.109860 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 418/820] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:38 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:39.267520 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-84320975-d381-4898-9b88-6da8e9dc5098 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:39.268215 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-84320975-d381-4898-9b88-6da8e9dc5098 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:39.274032 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84320975-d381-4898-9b88-6da8e9dc5098 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:39.274479 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84320975-d381-4898-9b88-6da8e9dc5098 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:39.275251 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84320975-d381-4898-9b88-6da8e9dc5098 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:39.275684 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-84320975-d381-4898-9b88-6da8e9dc5098 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:39.403939 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-84320975-d381-4898-9b88-6da8e9dc5098 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:39.411150 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-84320975-d381-4898-9b88-6da8e9dc5098 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1554 microversion: 2.1 time: 0.147737 Feb 21 01:39:39.411710 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 403/821] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:39 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:39.738022 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-127f8289-2be7-401b-96cf-4d80e38c40b6 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:39.738629 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-127f8289-2be7-401b-96cf-4d80e38c40b6 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:39.744588 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-127f8289-2be7-401b-96cf-4d80e38c40b6 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:39.745039 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-127f8289-2be7-401b-96cf-4d80e38c40b6 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:39.746333 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-127f8289-2be7-401b-96cf-4d80e38c40b6 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:39.746764 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-127f8289-2be7-401b-96cf-4d80e38c40b6 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:39.878499 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-127f8289-2be7-401b-96cf-4d80e38c40b6 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:39.886634 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-127f8289-2be7-401b-96cf-4d80e38c40b6 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1568 microversion: 2.1 time: 0.151685 Feb 21 01:39:39.887198 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 419/822] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:39 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:40.127132 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8238b9d5-555b-4793-b07d-9503dccb977e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:40.127691 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8238b9d5-555b-4793-b07d-9503dccb977e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:40.133995 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8238b9d5-555b-4793-b07d-9503dccb977e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:40.134464 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8238b9d5-555b-4793-b07d-9503dccb977e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:40.135512 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8238b9d5-555b-4793-b07d-9503dccb977e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:40.135948 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8238b9d5-555b-4793-b07d-9503dccb977e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:40.265071 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-8238b9d5-555b-4793-b07d-9503dccb977e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:40.272248 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8238b9d5-555b-4793-b07d-9503dccb977e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1672 microversion: 2.1 time: 0.148888 Feb 21 01:39:40.272838 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 404/823] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:40 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:40.428585 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c4b09961-97e6-4abd-8df8-0b716c69873d tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:40.429256 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c4b09961-97e6-4abd-8df8-0b716c69873d tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:40.436454 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4b09961-97e6-4abd-8df8-0b716c69873d tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:40.437000 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4b09961-97e6-4abd-8df8-0b716c69873d tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:40.437800 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4b09961-97e6-4abd-8df8-0b716c69873d tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:40.438238 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c4b09961-97e6-4abd-8df8-0b716c69873d tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:40.837324 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-c4b09961-97e6-4abd-8df8-0b716c69873d tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:40.845210 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c4b09961-97e6-4abd-8df8-0b716c69873d tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1554 microversion: 2.1 time: 0.420730 Feb 21 01:39:40.845780 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 420/824] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:40 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1554 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:40.903421 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6c22edae-d755-4ee3-be90-46604096ca64 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:40.904033 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6c22edae-d755-4ee3-be90-46604096ca64 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:40.909735 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c22edae-d755-4ee3-be90-46604096ca64 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:40.910182 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c22edae-d755-4ee3-be90-46604096ca64 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:40.910959 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c22edae-d755-4ee3-be90-46604096ca64 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:40.911388 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6c22edae-d755-4ee3-be90-46604096ca64 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:41.228607 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-6c22edae-d755-4ee3-be90-46604096ca64 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:41.235848 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6c22edae-d755-4ee3-be90-46604096ca64 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1568 microversion: 2.1 time: 0.336704 Feb 21 01:39:41.245904 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 405/825] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:40 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1568 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:41.289813 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0ae7ee95-a1ab-4b59-a42c-2f959ccd5df9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:41.290427 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0ae7ee95-a1ab-4b59-a42c-2f959ccd5df9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:41.296220 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ae7ee95-a1ab-4b59-a42c-2f959ccd5df9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:41.296704 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ae7ee95-a1ab-4b59-a42c-2f959ccd5df9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:41.297480 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ae7ee95-a1ab-4b59-a42c-2f959ccd5df9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:41.297916 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0ae7ee95-a1ab-4b59-a42c-2f959ccd5df9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:41.375153 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-0ae7ee95-a1ab-4b59-a42c-2f959ccd5df9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:41.382790 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0ae7ee95-a1ab-4b59-a42c-2f959ccd5df9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1604 microversion: 2.1 time: 0.096592 Feb 21 01:39:41.387405 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 421/826] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:41 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1604 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:41.496982 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-944b2626-743a-442c-9932-fcf42b18dc25 req-8078a619-a64e-4e1e-88ac-1edeedb4da53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b613c437-8337-4ce8-82d9-843cd6ccbc04", "name": "network-vif-deleted", "tag": "3c272f96-f321-4ccf-a91e-d7d0afd792b2"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:39:41.498540 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:39:41.498540 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:39:41.505216 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-944b2626-743a-442c-9932-fcf42b18dc25 req-8078a619-a64e-4e1e-88ac-1edeedb4da53 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:41.506630 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-944b2626-743a-442c-9932-fcf42b18dc25 req-8078a619-a64e-4e1e-88ac-1edeedb4da53 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:41.517280 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-944b2626-743a-442c-9932-fcf42b18dc25 req-8078a619-a64e-4e1e-88ac-1edeedb4da53 service nova] Creating event network-vif-deleted:3c272f96-f321-4ccf-a91e-d7d0afd792b2 for instance b613c437-8337-4ce8-82d9-843cd6ccbc04 on hv-cinder-81322 Feb 21 01:39:41.522024 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-944b2626-743a-442c-9932-fcf42b18dc25 req-8078a619-a64e-4e1e-88ac-1edeedb4da53 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029289 Feb 21 01:39:41.522605 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 406/827] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:39:41.862585 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-64ba79e9-4f29-45a8-9d09-9e7f29ee5a0b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:41.863384 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-64ba79e9-4f29-45a8-9d09-9e7f29ee5a0b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:41.871237 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64ba79e9-4f29-45a8-9d09-9e7f29ee5a0b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:41.871626 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64ba79e9-4f29-45a8-9d09-9e7f29ee5a0b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:41.872458 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64ba79e9-4f29-45a8-9d09-9e7f29ee5a0b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:41.872966 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64ba79e9-4f29-45a8-9d09-9e7f29ee5a0b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:41.930382 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64ba79e9-4f29-45a8-9d09-9e7f29ee5a0b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:41.931018 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-64ba79e9-4f29-45a8-9d09-9e7f29ee5a0b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:41.931694 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-64ba79e9-4f29-45a8-9d09-9e7f29ee5a0b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lazy-loading 'fault' on Instance uuid b613c437-8337-4ce8-82d9-843cd6ccbc04 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:39:41.989514 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-64ba79e9-4f29-45a8-9d09-9e7f29ee5a0b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c250b028df424333b3a2a87b54fcaef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784f5427745d402ba47e692082aac30f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:41.997495 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-64ba79e9-4f29-45a8-9d09-9e7f29ee5a0b tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 200 len: 1348 microversion: 2.1 time: 0.138710 Feb 21 01:39:41.998157 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 422/828] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:41 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 1348 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:42.257056 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-33c85473-cfe0-4d01-abdc-9e38bb63b513 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:42.258654 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-33c85473-cfe0-4d01-abdc-9e38bb63b513 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:42.267454 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-33c85473-cfe0-4d01-abdc-9e38bb63b513 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:42.271619 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-33c85473-cfe0-4d01-abdc-9e38bb63b513 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:42.271619 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-33c85473-cfe0-4d01-abdc-9e38bb63b513 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:42.271619 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-33c85473-cfe0-4d01-abdc-9e38bb63b513 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:42.400818 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ed5d31d2-80d6-4f11-95a5-a630a06d37b9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:42.402173 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ed5d31d2-80d6-4f11-95a5-a630a06d37b9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:42.408132 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed5d31d2-80d6-4f11-95a5-a630a06d37b9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:42.408931 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed5d31d2-80d6-4f11-95a5-a630a06d37b9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:42.409798 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed5d31d2-80d6-4f11-95a5-a630a06d37b9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:42.410261 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed5d31d2-80d6-4f11-95a5-a630a06d37b9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:42.442186 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed5d31d2-80d6-4f11-95a5-a630a06d37b9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:42.442635 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ed5d31d2-80d6-4f11-95a5-a630a06d37b9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:42.443099 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-ed5d31d2-80d6-4f11-95a5-a630a06d37b9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lazy-loading 'fault' on Instance uuid ff526a32-96c9-4481-a88c-a0913652acfd {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:39:42.496368 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-ed5d31d2-80d6-4f11-95a5-a630a06d37b9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:42.504115 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ed5d31d2-80d6-4f11-95a5-a630a06d37b9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 200 len: 1326 microversion: 2.1 time: 0.107013 Feb 21 01:39:42.504715 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 423/829] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:42 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 1326 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:39:42.519172 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-33c85473-cfe0-4d01-abdc-9e38bb63b513 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:42.527294 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-33c85473-cfe0-4d01-abdc-9e38bb63b513 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1568 microversion: 2.1 time: 0.276105 Feb 21 01:39:42.528178 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 407/830] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:42 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1568 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:43.014697 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f2d199fb-33a2-4384-bf45-dbd17e8e2102 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:43.015363 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f2d199fb-33a2-4384-bf45-dbd17e8e2102 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] [instance: b613c437-8337-4ce8-82d9-843cd6ccbc04] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:43.021577 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2d199fb-33a2-4384-bf45-dbd17e8e2102 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:43.022025 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2d199fb-33a2-4384-bf45-dbd17e8e2102 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:43.022845 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2d199fb-33a2-4384-bf45-dbd17e8e2102 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:43.023282 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f2d199fb-33a2-4384-bf45-dbd17e8e2102 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:43.036629 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-f2d199fb-33a2-4384-bf45-dbd17e8e2102 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] HTTP exception thrown: Instance b613c437-8337-4ce8-82d9-843cd6ccbc04 could not be found. Feb 21 01:39:43.037223 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f2d199fb-33a2-4384-bf45-dbd17e8e2102 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Returning 404 to user: Instance b613c437-8337-4ce8-82d9-843cd6ccbc04 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:39:43.038065 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f2d199fb-33a2-4384-bf45-dbd17e8e2102 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04" status: 404 len: 111 microversion: 2.1 time: 0.028069 Feb 21 01:39:43.038649 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 424/831] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:43 2022] GET /compute/v2.1/servers/b613c437-8337-4ce8-82d9-843cd6ccbc04 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:39:43.047372 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4fea32d5-e006-448b-9f70-19ac11c75fd5 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] Calling method '.version_select at 0x7f4075b58e50>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:43.150964 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4fea32d5-e006-448b-9f70-19ac11c75fd5 tempest-TestMinimumBasicScenario-1063093319 tempest-TestMinimumBasicScenario-1063093319-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1847498242" status: 202 len: 0 microversion: 2.1 time: 0.107459 Feb 21 01:39:43.151548 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 408/832] 10.222.0.90 () {58 vars in 1271 bytes} [Mon Feb 21 01:39:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1847498242 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:39:43.523520 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d29db837-8636-4152-8754-6a64ae6cf915 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:43.523520 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d29db837-8636-4152-8754-6a64ae6cf915 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:43.528757 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d29db837-8636-4152-8754-6a64ae6cf915 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:43.529498 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d29db837-8636-4152-8754-6a64ae6cf915 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:43.529991 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d29db837-8636-4152-8754-6a64ae6cf915 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:43.530428 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d29db837-8636-4152-8754-6a64ae6cf915 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:43.538894 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-ab28143e-2bd0-4eb0-8626-69604aa95b6a req-584a7a34-49ac-45c6-b5af-50c6b343bdab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff526a32-96c9-4481-a88c-a0913652acfd", "name": "network-vif-deleted", "tag": "fe876a1a-56e9-4821-ac6c-94fe28a1852e"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:39:43.540260 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:39:43.540260 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:39:43.544750 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-d29db837-8636-4152-8754-6a64ae6cf915 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] HTTP exception thrown: Instance ff526a32-96c9-4481-a88c-a0913652acfd could not be found. Feb 21 01:39:43.545498 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d29db837-8636-4152-8754-6a64ae6cf915 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Returning 404 to user: Instance ff526a32-96c9-4481-a88c-a0913652acfd could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:39:43.546344 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d29db837-8636-4152-8754-6a64ae6cf915 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 404 len: 111 microversion: 2.1 time: 0.028864 Feb 21 01:39:43.547240 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 425/833] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:43 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:39:43.548659 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ab28143e-2bd0-4eb0-8626-69604aa95b6a req-584a7a34-49ac-45c6-b5af-50c6b343bdab service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:43.549112 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ab28143e-2bd0-4eb0-8626-69604aa95b6a req-584a7a34-49ac-45c6-b5af-50c6b343bdab service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:43.551534 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f8d0c4f0-e3ba-4aed-ac33-d48e2c399759 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:43.552152 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f8d0c4f0-e3ba-4aed-ac33-d48e2c399759 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:43.559980 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8d0c4f0-e3ba-4aed-ac33-d48e2c399759 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:43.560538 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8d0c4f0-e3ba-4aed-ac33-d48e2c399759 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:43.561398 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8d0c4f0-e3ba-4aed-ac33-d48e2c399759 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:43.561845 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f8d0c4f0-e3ba-4aed-ac33-d48e2c399759 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:43.567115 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-ab28143e-2bd0-4eb0-8626-69604aa95b6a req-584a7a34-49ac-45c6-b5af-50c6b343bdab service nova] Creating event network-vif-deleted:fe876a1a-56e9-4821-ac6c-94fe28a1852e for instance ff526a32-96c9-4481-a88c-a0913652acfd on hv-cinder-81322 Feb 21 01:39:43.572358 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-ab28143e-2bd0-4eb0-8626-69604aa95b6a req-584a7a34-49ac-45c6-b5af-50c6b343bdab service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037280 Feb 21 01:39:43.573564 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 409/834] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:39:43.578227 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e0244ccc-1866-465f-83f8-b613f5853819 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '.version_select at 0x7f4075d30280>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:43.665192 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e0244ccc-1866-465f-83f8-b613f5853819 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-287381293" status: 202 len: 0 microversion: 2.1 time: 0.090468 Feb 21 01:39:43.671323 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 410/835] 10.222.0.90 () {58 vars in 1217 bytes} [Mon Feb 21 01:39:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-287381293 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:39:43.700096 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-f8d0c4f0-e3ba-4aed-ac33-d48e2c399759 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:43.707488 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f8d0c4f0-e3ba-4aed-ac33-d48e2c399759 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1568 microversion: 2.1 time: 0.159326 Feb 21 01:39:43.708061 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 426/836] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:43 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:44.444995 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e7a7ff05-65b3-494e-93ab-607ad601974d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Action: 'create', calling method: .version_select at 0x7f4075b58820>, body: {"keypair": {"name": "tempest-keypair-1685777227"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:39:44.458975 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-e7a7ff05-65b3-494e-93ab-607ad601974d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Getting quotas for project 09bc5c58fd414c8aa76756065678191e. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:39:44.462718 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-e7a7ff05-65b3-494e-93ab-607ad601974d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Getting quotas for user 4d834a0b1ec1481eaf1387dd4e302cd3 and project 09bc5c58fd414c8aa76756065678191e. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:39:44.600486 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-e7a7ff05-65b3-494e-93ab-607ad601974d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Getting quotas for project 09bc5c58fd414c8aa76756065678191e. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:39:44.604169 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-e7a7ff05-65b3-494e-93ab-607ad601974d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Getting quotas for user 4d834a0b1ec1481eaf1387dd4e302cd3 and project 09bc5c58fd414c8aa76756065678191e. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:39:44.623415 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e7a7ff05-65b3-494e-93ab-607ad601974d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.182084 Feb 21 01:39:44.624361 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 411/837] 10.222.0.90 () {60 vars in 1157 bytes} [Mon Feb 21 01:39:44 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:44.724777 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-06338ae5-0a15-4b9d-8d1b-95c5ea8984ed tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:44.725345 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-06338ae5-0a15-4b9d-8d1b-95c5ea8984ed tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:44.731931 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06338ae5-0a15-4b9d-8d1b-95c5ea8984ed tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:44.732375 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06338ae5-0a15-4b9d-8d1b-95c5ea8984ed tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:44.733170 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06338ae5-0a15-4b9d-8d1b-95c5ea8984ed tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:44.733599 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-06338ae5-0a15-4b9d-8d1b-95c5ea8984ed tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:44.940135 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-06338ae5-0a15-4b9d-8d1b-95c5ea8984ed tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:44.947959 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-06338ae5-0a15-4b9d-8d1b-95c5ea8984ed tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1568 microversion: 2.1 time: 0.227057 Feb 21 01:39:44.948736 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 427/838] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:44 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:45.965637 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-47ce03c7-26e1-4a8c-9735-e2c9f3ed1ca2 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:45.966533 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-47ce03c7-26e1-4a8c-9735-e2c9f3ed1ca2 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:45.973316 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47ce03c7-26e1-4a8c-9735-e2c9f3ed1ca2 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:45.973897 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47ce03c7-26e1-4a8c-9735-e2c9f3ed1ca2 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:45.974799 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47ce03c7-26e1-4a8c-9735-e2c9f3ed1ca2 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:45.975368 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-47ce03c7-26e1-4a8c-9735-e2c9f3ed1ca2 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:46.205656 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-47ce03c7-26e1-4a8c-9735-e2c9f3ed1ca2 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:46.216040 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-47ce03c7-26e1-4a8c-9735-e2c9f3ed1ca2 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1509 microversion: 2.1 time: 0.254854 Feb 21 01:39:46.217288 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 412/839] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:45 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1509 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:46.233566 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-59ff16dd-e034-414d-9b98-a75a8f947f22 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:39:46.234902 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-59ff16dd-e034-414d-9b98-a75a8f947f22 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:46.241810 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59ff16dd-e034-414d-9b98-a75a8f947f22 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:46.242560 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59ff16dd-e034-414d-9b98-a75a8f947f22 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:46.243395 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59ff16dd-e034-414d-9b98-a75a8f947f22 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:46.244047 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59ff16dd-e034-414d-9b98-a75a8f947f22 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:46.426358 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-59ff16dd-e034-414d-9b98-a75a8f947f22 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "POST /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338/action" status: 202 len: 0 microversion: 2.1 time: 0.196914 Feb 21 01:39:46.427300 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 428/840] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Feb 21 01:39:46 2022] POST /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:39:46.436620 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-346a1ebc-642a-42c4-b713-90610bd47fa8 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:46.436979 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-346a1ebc-642a-42c4-b713-90610bd47fa8 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:46.443383 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-346a1ebc-642a-42c4-b713-90610bd47fa8 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:46.443937 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-346a1ebc-642a-42c4-b713-90610bd47fa8 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:46.444824 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-346a1ebc-642a-42c4-b713-90610bd47fa8 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:46.445478 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-346a1ebc-642a-42c4-b713-90610bd47fa8 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:46.772368 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-346a1ebc-642a-42c4-b713-90610bd47fa8 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:46.780543 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-346a1ebc-642a-42c4-b713-90610bd47fa8 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1517 microversion: 2.1 time: 0.348189 Feb 21 01:39:46.790412 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 413/841] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:46 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1517 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:47.139485 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-445e86fb-5819-46b0-b348-08c9ac8b9c1e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-148350777", "imageRef": "35936a71-5ec3-4154-b01a-f2dafd8c0364", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "27d681c4-c216-4785-93dd-e8601d1c0576"}], "security_groups": [{"name": "tempest-securitygroup--251066792"}], "key_name": "tempest-keypair-1685777227", "user_data": "}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:39:47.257147 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-445e86fb-5819-46b0-b348-08c9ac8b9c1e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] validate_networks() for [('27d681c4-c216-4785-93dd-e8601d1c0576', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:39:47.703711 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-445e86fb-5819-46b0-b348-08c9ac8b9c1e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:39:47.704354 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-445e86fb-5819-46b0-b348-08c9ac8b9c1e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:39:47.704863 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-445e86fb-5819-46b0-b348-08c9ac8b9c1e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:39:47.705478 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-445e86fb-5819-46b0-b348-08c9ac8b9c1e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:39:47.706072 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-445e86fb-5819-46b0-b348-08c9ac8b9c1e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:39:47.715431 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-445e86fb-5819-46b0-b348-08c9ac8b9c1e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:47.716084 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-445e86fb-5819-46b0-b348-08c9ac8b9c1e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:47.716925 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-445e86fb-5819-46b0-b348-08c9ac8b9c1e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:47.717364 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-445e86fb-5819-46b0-b348-08c9ac8b9c1e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:47.736212 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-445e86fb-5819-46b0-b348-08c9ac8b9c1e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Getting quotas for project 09bc5c58fd414c8aa76756065678191e. Resources: {'ram', 'cores', 'instances'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:39:47.749393 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-445e86fb-5819-46b0-b348-08c9ac8b9c1e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Getting quotas for user 4d834a0b1ec1481eaf1387dd4e302cd3 and project 09bc5c58fd414c8aa76756065678191e. Resources: {'ram', 'cores', 'instances'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:39:47.770273 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-445e86fb-5819-46b0-b348-08c9ac8b9c1e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:39:47.772863 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-445e86fb-5819-46b0-b348-08c9ac8b9c1e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35936a71-5ec3-4154-b01a-f2dafd8c0364',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:39:47.798332 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ee0a57d2-c07a-46f1-bc8d-a6ed8b998388 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:47.799324 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ee0a57d2-c07a-46f1-bc8d-a6ed8b998388 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:47.807059 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee0a57d2-c07a-46f1-bc8d-a6ed8b998388 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:47.807800 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee0a57d2-c07a-46f1-bc8d-a6ed8b998388 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:47.808812 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee0a57d2-c07a-46f1-bc8d-a6ed8b998388 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:47.809341 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ee0a57d2-c07a-46f1-bc8d-a6ed8b998388 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:47.915062 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-445e86fb-5819-46b0-b348-08c9ac8b9c1e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.781240 Feb 21 01:39:47.919670 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 429/842] 10.222.0.90 () {60 vars in 1146 bytes} [Mon Feb 21 01:39:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:39:47.929052 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6a9a6591-dbce-4866-826b-eecba2590070 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:47.934120 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6a9a6591-dbce-4866-826b-eecba2590070 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:48.008964 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ee0a57d2-c07a-46f1-bc8d-a6ed8b998388 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:48.019800 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ee0a57d2-c07a-46f1-bc8d-a6ed8b998388 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1517 microversion: 2.1 time: 0.225853 Feb 21 01:39:48.025102 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 414/843] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:47 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1517 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:48.062146 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-6a9a6591-dbce-4866-826b-eecba2590070 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:48.070380 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6a9a6591-dbce-4866-826b-eecba2590070 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440" status: 200 len: 1237 microversion: 2.1 time: 0.145064 Feb 21 01:39:48.072141 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 430/844] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:47 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440 => generated 1237 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:48.930251 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-ff9e2aed-ef25-4c65-a1d1-a4257c474bc1 req-cd46af98-993f-4870-862d-167dd356066f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bfdab9d-ba0f-4923-ad4e-40ef23db9338", "name": "network-vif-unplugged", "status": "completed", "tag": "682a620b-646c-4dfa-8198-bae01e8d1e36"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:39:48.931874 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:39:48.931874 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:39:48.940147 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ff9e2aed-ef25-4c65-a1d1-a4257c474bc1 req-cd46af98-993f-4870-862d-167dd356066f service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:48.944419 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ff9e2aed-ef25-4c65-a1d1-a4257c474bc1 req-cd46af98-993f-4870-862d-167dd356066f service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:48.951625 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.compute.server_external_events [req-ff9e2aed-ef25-4c65-a1d1-a4257c474bc1 req-cd46af98-993f-4870-862d-167dd356066f service nova] Unable to find a host for instance 3bfdab9d-ba0f-4923-ad4e-40ef23db9338. Dropping event network-vif-unplugged {{(pid=123542) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 21 01:39:48.952787 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-ff9e2aed-ef25-4c65-a1d1-a4257c474bc1 req-cd46af98-993f-4870-862d-167dd356066f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026703 Feb 21 01:39:48.953585 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 415/845] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 21 01:39:49.042713 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-24a8af8b-e985-4533-9718-22a58a99e4dd tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:49.043329 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-24a8af8b-e985-4533-9718-22a58a99e4dd tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:49.052390 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-24a8af8b-e985-4533-9718-22a58a99e4dd tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:49.052855 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-24a8af8b-e985-4533-9718-22a58a99e4dd tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:49.053632 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-24a8af8b-e985-4533-9718-22a58a99e4dd tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:49.057940 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-24a8af8b-e985-4533-9718-22a58a99e4dd tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:49.091859 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a26344f0-572e-4928-8b13-5a4164bb8af1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:49.093036 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a26344f0-572e-4928-8b13-5a4164bb8af1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:49.099788 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a26344f0-572e-4928-8b13-5a4164bb8af1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:49.100678 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a26344f0-572e-4928-8b13-5a4164bb8af1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:49.102201 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a26344f0-572e-4928-8b13-5a4164bb8af1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:49.102972 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a26344f0-572e-4928-8b13-5a4164bb8af1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:49.185878 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-a26344f0-572e-4928-8b13-5a4164bb8af1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:49.193462 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a26344f0-572e-4928-8b13-5a4164bb8af1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440" status: 200 len: 1241 microversion: 2.1 time: 0.107684 Feb 21 01:39:49.204621 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 416/846] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:49 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440 => generated 1241 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:49.313360 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-24a8af8b-e985-4533-9718-22a58a99e4dd tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:49.321654 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-24a8af8b-e985-4533-9718-22a58a99e4dd tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1519 microversion: 2.1 time: 0.283233 Feb 21 01:39:49.322256 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 431/847] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:49 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1519 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:50.223046 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-596e0ce3-a007-4602-a1bd-550f05244cdf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:50.223694 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-596e0ce3-a007-4602-a1bd-550f05244cdf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:50.231256 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-596e0ce3-a007-4602-a1bd-550f05244cdf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:50.231710 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-596e0ce3-a007-4602-a1bd-550f05244cdf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:50.232543 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-596e0ce3-a007-4602-a1bd-550f05244cdf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:50.232989 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-596e0ce3-a007-4602-a1bd-550f05244cdf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:50.339667 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f3ce8b12-e97b-41f8-87ee-752f1fb1bdce tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:50.340270 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f3ce8b12-e97b-41f8-87ee-752f1fb1bdce tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:50.346602 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3ce8b12-e97b-41f8-87ee-752f1fb1bdce tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:50.347041 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3ce8b12-e97b-41f8-87ee-752f1fb1bdce tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:50.347812 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3ce8b12-e97b-41f8-87ee-752f1fb1bdce tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:50.348240 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3ce8b12-e97b-41f8-87ee-752f1fb1bdce tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:50.492449 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-596e0ce3-a007-4602-a1bd-550f05244cdf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:50.499883 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-596e0ce3-a007-4602-a1bd-550f05244cdf tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440" status: 200 len: 1295 microversion: 2.1 time: 0.280365 Feb 21 01:39:50.500273 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 417/848] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:50 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440 => generated 1295 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:50.841967 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-f3ce8b12-e97b-41f8-87ee-752f1fb1bdce tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:50.849154 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f3ce8b12-e97b-41f8-87ee-752f1fb1bdce tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1575 microversion: 2.1 time: 0.513698 Feb 21 01:39:50.849726 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 432/849] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:50 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1575 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:39:51.518902 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8c5f6f44-d328-4f70-a666-683129c06cc2 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:51.520127 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8c5f6f44-d328-4f70-a666-683129c06cc2 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:51.529039 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c5f6f44-d328-4f70-a666-683129c06cc2 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:51.529828 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c5f6f44-d328-4f70-a666-683129c06cc2 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:51.531355 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c5f6f44-d328-4f70-a666-683129c06cc2 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:51.531979 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8c5f6f44-d328-4f70-a666-683129c06cc2 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:51.751327 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-8c5f6f44-d328-4f70-a666-683129c06cc2 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:51.768147 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8c5f6f44-d328-4f70-a666-683129c06cc2 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440" status: 200 len: 1362 microversion: 2.1 time: 0.255303 Feb 21 01:39:51.780272 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 418/850] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:51 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440 => generated 1362 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:51.866006 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-15856c28-9769-4fd2-b919-cb5df3a6bc4b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:51.866741 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-15856c28-9769-4fd2-b919-cb5df3a6bc4b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:51.873253 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15856c28-9769-4fd2-b919-cb5df3a6bc4b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:51.873824 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15856c28-9769-4fd2-b919-cb5df3a6bc4b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:51.874724 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15856c28-9769-4fd2-b919-cb5df3a6bc4b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:51.875251 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-15856c28-9769-4fd2-b919-cb5df3a6bc4b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:52.165345 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-15856c28-9769-4fd2-b919-cb5df3a6bc4b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:52.172613 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-15856c28-9769-4fd2-b919-cb5df3a6bc4b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1575 microversion: 2.1 time: 0.310387 Feb 21 01:39:52.173107 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 433/851] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:51 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1575 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:52.625810 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-b7b65814-86aa-4e46-b909-0ce4d0cbd407 req-e9009ff4-fb37-4bee-97be-2c1a1beb218d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ebd735-bf6a-4bf3-a66f-e1760c542440", "tag": "1586cbad-a660-482d-a053-cbacd581a4bd"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:39:52.627897 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:39:52.627897 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:39:52.638824 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b7b65814-86aa-4e46-b909-0ce4d0cbd407 req-e9009ff4-fb37-4bee-97be-2c1a1beb218d service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:52.639268 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b7b65814-86aa-4e46-b909-0ce4d0cbd407 req-e9009ff4-fb37-4bee-97be-2c1a1beb218d service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:52.660036 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-b7b65814-86aa-4e46-b909-0ce4d0cbd407 req-e9009ff4-fb37-4bee-97be-2c1a1beb218d service nova] Creating event network-changed:1586cbad-a660-482d-a053-cbacd581a4bd for instance 17ebd735-bf6a-4bf3-a66f-e1760c542440 on hv-cinder-81322 Feb 21 01:39:52.672467 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-b7b65814-86aa-4e46-b909-0ce4d0cbd407 req-e9009ff4-fb37-4bee-97be-2c1a1beb218d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057107 Feb 21 01:39:52.678342 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 419/852] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:39:52.786162 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5bc6a46c-9910-4bcc-9fa5-c091daa05627 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:52.786785 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5bc6a46c-9910-4bcc-9fa5-c091daa05627 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:52.796076 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bc6a46c-9910-4bcc-9fa5-c091daa05627 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:52.796563 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bc6a46c-9910-4bcc-9fa5-c091daa05627 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:52.797373 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bc6a46c-9910-4bcc-9fa5-c091daa05627 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:52.802229 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5bc6a46c-9910-4bcc-9fa5-c091daa05627 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:53.066957 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-5bc6a46c-9910-4bcc-9fa5-c091daa05627 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:53.074510 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5bc6a46c-9910-4bcc-9fa5-c091daa05627 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440" status: 200 len: 1362 microversion: 2.1 time: 0.292167 Feb 21 01:39:53.083918 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 434/853] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:52 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440 => generated 1362 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:53.189905 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-044d1455-9ef1-4ef2-a4ae-e04d8e09c312 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:53.190924 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-044d1455-9ef1-4ef2-a4ae-e04d8e09c312 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:53.197929 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-044d1455-9ef1-4ef2-a4ae-e04d8e09c312 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:53.198636 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-044d1455-9ef1-4ef2-a4ae-e04d8e09c312 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:53.199673 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-044d1455-9ef1-4ef2-a4ae-e04d8e09c312 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:53.200357 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-044d1455-9ef1-4ef2-a4ae-e04d8e09c312 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:53.428573 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-044d1455-9ef1-4ef2-a4ae-e04d8e09c312 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:53.436585 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-044d1455-9ef1-4ef2-a4ae-e04d8e09c312 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1575 microversion: 2.1 time: 0.250687 Feb 21 01:39:53.437719 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 420/854] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:53 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1575 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:54.090841 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e105312a-337e-4a51-a4e5-6d6b8815432f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:54.091452 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e105312a-337e-4a51-a4e5-6d6b8815432f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:54.097629 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e105312a-337e-4a51-a4e5-6d6b8815432f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:54.098079 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e105312a-337e-4a51-a4e5-6d6b8815432f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:54.098850 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e105312a-337e-4a51-a4e5-6d6b8815432f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:54.099280 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e105312a-337e-4a51-a4e5-6d6b8815432f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:54.235673 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-e105312a-337e-4a51-a4e5-6d6b8815432f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:54.242894 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e105312a-337e-4a51-a4e5-6d6b8815432f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440" status: 200 len: 1362 microversion: 2.1 time: 0.155697 Feb 21 01:39:54.243456 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 435/855] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:54 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:54.453905 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-97e9b2e7-3875-4d5d-8c8f-ded23453ca98 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:54.454561 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-97e9b2e7-3875-4d5d-8c8f-ded23453ca98 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:54.460731 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97e9b2e7-3875-4d5d-8c8f-ded23453ca98 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:54.461224 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97e9b2e7-3875-4d5d-8c8f-ded23453ca98 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:54.462001 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97e9b2e7-3875-4d5d-8c8f-ded23453ca98 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:54.462437 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-97e9b2e7-3875-4d5d-8c8f-ded23453ca98 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:54.595499 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-97e9b2e7-3875-4d5d-8c8f-ded23453ca98 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:54.603234 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-97e9b2e7-3875-4d5d-8c8f-ded23453ca98 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1575 microversion: 2.1 time: 0.152967 Feb 21 01:39:54.603808 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 421/856] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:54 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:55.260592 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5fbed7eb-5c04-43ee-95e0-4213174c232a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:55.261211 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5fbed7eb-5c04-43ee-95e0-4213174c232a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:55.268663 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fbed7eb-5c04-43ee-95e0-4213174c232a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:55.269136 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fbed7eb-5c04-43ee-95e0-4213174c232a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:55.269945 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fbed7eb-5c04-43ee-95e0-4213174c232a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:55.270410 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5fbed7eb-5c04-43ee-95e0-4213174c232a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:55.406264 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-5fbed7eb-5c04-43ee-95e0-4213174c232a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:55.413333 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5fbed7eb-5c04-43ee-95e0-4213174c232a tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440" status: 200 len: 1362 microversion: 2.1 time: 0.156862 Feb 21 01:39:55.413887 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 436/857] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:55 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:55.619513 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b8b1f7d5-12b0-40e3-98b3-d5103f83a46d tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:55.620132 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b8b1f7d5-12b0-40e3-98b3-d5103f83a46d tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:55.626921 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b8b1f7d5-12b0-40e3-98b3-d5103f83a46d tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:55.627448 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b8b1f7d5-12b0-40e3-98b3-d5103f83a46d tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:55.628779 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b8b1f7d5-12b0-40e3-98b3-d5103f83a46d tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:55.629216 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b8b1f7d5-12b0-40e3-98b3-d5103f83a46d tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:55.766564 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-b8b1f7d5-12b0-40e3-98b3-d5103f83a46d tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:55.773854 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b8b1f7d5-12b0-40e3-98b3-d5103f83a46d tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1575 microversion: 2.1 time: 0.158173 Feb 21 01:39:55.774420 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 422/858] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:55 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:56.432748 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b8c77ea1-0836-4ccf-a42b-9d518749092c tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:56.433326 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b8c77ea1-0836-4ccf-a42b-9d518749092c tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:56.439520 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8c77ea1-0836-4ccf-a42b-9d518749092c tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:56.439963 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8c77ea1-0836-4ccf-a42b-9d518749092c tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:56.440757 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8c77ea1-0836-4ccf-a42b-9d518749092c tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:56.441187 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b8c77ea1-0836-4ccf-a42b-9d518749092c tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:56.574425 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b8c77ea1-0836-4ccf-a42b-9d518749092c tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:56.581548 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b8c77ea1-0836-4ccf-a42b-9d518749092c tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440" status: 200 len: 1362 microversion: 2.1 time: 0.152986 Feb 21 01:39:56.582115 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 437/859] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:56 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:56.790984 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3c46cb1f-ca38-454e-b72d-664b02825350 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:56.792011 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3c46cb1f-ca38-454e-b72d-664b02825350 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:56.798184 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c46cb1f-ca38-454e-b72d-664b02825350 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:56.798627 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c46cb1f-ca38-454e-b72d-664b02825350 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:56.799385 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c46cb1f-ca38-454e-b72d-664b02825350 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:56.799810 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3c46cb1f-ca38-454e-b72d-664b02825350 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:56.930552 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-3c46cb1f-ca38-454e-b72d-664b02825350 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:56.937837 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3c46cb1f-ca38-454e-b72d-664b02825350 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1575 microversion: 2.1 time: 0.150695 Feb 21 01:39:56.938407 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 423/860] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:56 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:57.598245 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a281f83d-44c7-40cc-8375-d63667e140db tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:57.598829 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a281f83d-44c7-40cc-8375-d63667e140db tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:57.605064 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a281f83d-44c7-40cc-8375-d63667e140db tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:57.605507 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a281f83d-44c7-40cc-8375-d63667e140db tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:57.606267 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a281f83d-44c7-40cc-8375-d63667e140db tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:57.606693 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a281f83d-44c7-40cc-8375-d63667e140db tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:57.743715 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-a281f83d-44c7-40cc-8375-d63667e140db tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:57.751496 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a281f83d-44c7-40cc-8375-d63667e140db tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440" status: 200 len: 1362 microversion: 2.1 time: 0.156940 Feb 21 01:39:57.752064 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 438/861] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:57 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:57.954559 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ad305461-0819-46f5-9179-78ab01045e69 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:57.955197 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ad305461-0819-46f5-9179-78ab01045e69 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:57.961796 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad305461-0819-46f5-9179-78ab01045e69 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:57.962244 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad305461-0819-46f5-9179-78ab01045e69 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:57.963019 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad305461-0819-46f5-9179-78ab01045e69 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:57.963453 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ad305461-0819-46f5-9179-78ab01045e69 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:58.092501 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ad305461-0819-46f5-9179-78ab01045e69 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:58.099739 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ad305461-0819-46f5-9179-78ab01045e69 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1575 microversion: 2.1 time: 0.148899 Feb 21 01:39:58.100300 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 424/862] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:57 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:58.769000 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-20ca2458-0cc9-48e7-b14d-cdd73c8d2ca9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:58.769607 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-20ca2458-0cc9-48e7-b14d-cdd73c8d2ca9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:58.776270 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20ca2458-0cc9-48e7-b14d-cdd73c8d2ca9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:58.776752 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20ca2458-0cc9-48e7-b14d-cdd73c8d2ca9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:58.777522 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20ca2458-0cc9-48e7-b14d-cdd73c8d2ca9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:58.777954 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20ca2458-0cc9-48e7-b14d-cdd73c8d2ca9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:58.911085 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-20ca2458-0cc9-48e7-b14d-cdd73c8d2ca9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:58.918195 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-20ca2458-0cc9-48e7-b14d-cdd73c8d2ca9 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440" status: 200 len: 1362 microversion: 2.1 time: 0.152828 Feb 21 01:39:58.918835 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 439/863] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:58 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:59.116989 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-aef127d2-52fb-4b1e-9b15-d92a73cd7a84 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:59.117628 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-aef127d2-52fb-4b1e-9b15-d92a73cd7a84 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:59.124779 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aef127d2-52fb-4b1e-9b15-d92a73cd7a84 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:59.125419 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aef127d2-52fb-4b1e-9b15-d92a73cd7a84 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:59.126212 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aef127d2-52fb-4b1e-9b15-d92a73cd7a84 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:59.126644 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-aef127d2-52fb-4b1e-9b15-d92a73cd7a84 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:59.256386 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-aef127d2-52fb-4b1e-9b15-d92a73cd7a84 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:39:59.264621 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-aef127d2-52fb-4b1e-9b15-d92a73cd7a84 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1575 microversion: 2.1 time: 0.151331 Feb 21 01:39:59.265189 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 425/864] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:59 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:39:59.934926 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3ade9786-28de-495c-96ab-7059eaa243c6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:39:59.935482 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3ade9786-28de-495c-96ab-7059eaa243c6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:39:59.941675 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ade9786-28de-495c-96ab-7059eaa243c6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:59.942132 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ade9786-28de-495c-96ab-7059eaa243c6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:39:59.942913 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ade9786-28de-495c-96ab-7059eaa243c6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:39:59.943349 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3ade9786-28de-495c-96ab-7059eaa243c6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:00.070751 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-3ade9786-28de-495c-96ab-7059eaa243c6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:00.077883 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3ade9786-28de-495c-96ab-7059eaa243c6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440" status: 200 len: 1362 microversion: 2.1 time: 0.146681 Feb 21 01:40:00.078448 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 440/865] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:39:59 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:00.281835 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0ab97fef-820c-4083-aee9-2c988bc66a6b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:00.282406 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0ab97fef-820c-4083-aee9-2c988bc66a6b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:00.288657 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ab97fef-820c-4083-aee9-2c988bc66a6b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:00.289107 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ab97fef-820c-4083-aee9-2c988bc66a6b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:00.289886 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ab97fef-820c-4083-aee9-2c988bc66a6b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:00.290326 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ab97fef-820c-4083-aee9-2c988bc66a6b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:00.421887 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-0ab97fef-820c-4083-aee9-2c988bc66a6b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:00.429307 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0ab97fef-820c-4083-aee9-2c988bc66a6b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1575 microversion: 2.1 time: 0.151209 Feb 21 01:40:00.429885 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 426/866] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:00 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:01.094584 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8580cd89-53a5-42d9-8557-28b1e84ac65f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:01.095383 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8580cd89-53a5-42d9-8557-28b1e84ac65f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:01.101961 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8580cd89-53a5-42d9-8557-28b1e84ac65f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:01.102418 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8580cd89-53a5-42d9-8557-28b1e84ac65f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:01.103210 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8580cd89-53a5-42d9-8557-28b1e84ac65f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:01.104145 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8580cd89-53a5-42d9-8557-28b1e84ac65f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:01.169490 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-7c610948-23cd-4c4d-8b4e-1417dd2a01d1 req-f6bf6f15-3642-4195-9ab4-a0b720b87c28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ebd735-bf6a-4bf3-a66f-e1760c542440", "name": "network-vif-plugged", "status": "completed", "tag": "1586cbad-a660-482d-a053-cbacd581a4bd"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:40:01.171006 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:40:01.171006 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:40:01.181316 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7c610948-23cd-4c4d-8b4e-1417dd2a01d1 req-f6bf6f15-3642-4195-9ab4-a0b720b87c28 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:01.181776 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-7c610948-23cd-4c4d-8b4e-1417dd2a01d1 req-f6bf6f15-3642-4195-9ab4-a0b720b87c28 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:01.193851 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-7c610948-23cd-4c4d-8b4e-1417dd2a01d1 req-f6bf6f15-3642-4195-9ab4-a0b720b87c28 service nova] Creating event network-vif-plugged:1586cbad-a660-482d-a053-cbacd581a4bd for instance 17ebd735-bf6a-4bf3-a66f-e1760c542440 on hv-cinder-81322 Feb 21 01:40:01.200079 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-7c610948-23cd-4c4d-8b4e-1417dd2a01d1 req-f6bf6f15-3642-4195-9ab4-a0b720b87c28 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033383 Feb 21 01:40:01.200079 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 427/867] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:40:01.253885 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-8580cd89-53a5-42d9-8557-28b1e84ac65f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:01.261988 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8580cd89-53a5-42d9-8557-28b1e84ac65f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440" status: 200 len: 1362 microversion: 2.1 time: 0.170960 Feb 21 01:40:01.262733 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 441/868] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:01 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:01.446609 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-02684fb6-5086-4ff0-8dd2-318e430b2313 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:01.447332 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-02684fb6-5086-4ff0-8dd2-318e430b2313 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:01.454435 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02684fb6-5086-4ff0-8dd2-318e430b2313 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:01.454889 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02684fb6-5086-4ff0-8dd2-318e430b2313 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:01.455678 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02684fb6-5086-4ff0-8dd2-318e430b2313 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:01.456116 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02684fb6-5086-4ff0-8dd2-318e430b2313 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:01.618554 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-02684fb6-5086-4ff0-8dd2-318e430b2313 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:01.625796 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-02684fb6-5086-4ff0-8dd2-318e430b2313 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1575 microversion: 2.1 time: 0.183293 Feb 21 01:40:01.626375 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 428/869] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:01 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1575 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:02.278701 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-236cce92-94e7-4b21-a12c-548aba560d00 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:02.279313 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-236cce92-94e7-4b21-a12c-548aba560d00 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:02.285528 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-236cce92-94e7-4b21-a12c-548aba560d00 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:02.285977 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-236cce92-94e7-4b21-a12c-548aba560d00 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:02.286747 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-236cce92-94e7-4b21-a12c-548aba560d00 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:02.287181 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-236cce92-94e7-4b21-a12c-548aba560d00 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:02.415914 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-236cce92-94e7-4b21-a12c-548aba560d00 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:02.423066 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-236cce92-94e7-4b21-a12c-548aba560d00 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440" status: 200 len: 1362 microversion: 2.1 time: 0.147964 Feb 21 01:40:02.423631 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 442/870] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:02 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:02.641771 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fce35ac9-ef90-475e-a542-4cd27298a2f7 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:02.642911 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fce35ac9-ef90-475e-a542-4cd27298a2f7 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:02.649662 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fce35ac9-ef90-475e-a542-4cd27298a2f7 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:02.650114 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fce35ac9-ef90-475e-a542-4cd27298a2f7 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:02.650894 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fce35ac9-ef90-475e-a542-4cd27298a2f7 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:02.651330 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fce35ac9-ef90-475e-a542-4cd27298a2f7 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:02.784963 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-fce35ac9-ef90-475e-a542-4cd27298a2f7 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:02.792987 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fce35ac9-ef90-475e-a542-4cd27298a2f7 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1575 microversion: 2.1 time: 0.154844 Feb 21 01:40:02.793560 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 429/871] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:02 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:03.213929 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-c2b0c733-506d-4ea1-bc82-b1b8468faf1c req-7e38755d-682e-431e-a93b-8e3d206bb5e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bfdab9d-ba0f-4923-ad4e-40ef23db9338", "name": "network-vif-plugged", "status": "completed", "tag": "682a620b-646c-4dfa-8198-bae01e8d1e36"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:40:03.218213 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:40:03.218213 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:40:03.222212 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c2b0c733-506d-4ea1-bc82-b1b8468faf1c req-7e38755d-682e-431e-a93b-8e3d206bb5e5 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:03.222649 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-c2b0c733-506d-4ea1-bc82-b1b8468faf1c req-7e38755d-682e-431e-a93b-8e3d206bb5e5 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:03.233755 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-c2b0c733-506d-4ea1-bc82-b1b8468faf1c req-7e38755d-682e-431e-a93b-8e3d206bb5e5 service nova] Creating event network-vif-plugged:682a620b-646c-4dfa-8198-bae01e8d1e36 for instance 3bfdab9d-ba0f-4923-ad4e-40ef23db9338 on hv-cinder-81322 Feb 21 01:40:03.238601 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-c2b0c733-506d-4ea1-bc82-b1b8468faf1c req-7e38755d-682e-431e-a93b-8e3d206bb5e5 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028820 Feb 21 01:40:03.239172 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 443/872] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:40:03.440382 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-227fafb4-b1a3-44f3-8051-56d14e192672 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:03.440952 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-227fafb4-b1a3-44f3-8051-56d14e192672 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:03.446997 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-227fafb4-b1a3-44f3-8051-56d14e192672 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:03.447452 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-227fafb4-b1a3-44f3-8051-56d14e192672 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:03.448287 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-227fafb4-b1a3-44f3-8051-56d14e192672 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:03.448695 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-227fafb4-b1a3-44f3-8051-56d14e192672 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:03.634064 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-227fafb4-b1a3-44f3-8051-56d14e192672 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:03.641628 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-227fafb4-b1a3-44f3-8051-56d14e192672 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440" status: 200 len: 1549 microversion: 2.1 time: 0.205131 Feb 21 01:40:03.642197 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 430/873] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:03 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440 => generated 1549 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:03.659537 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a2c6e6e9-34f9-4d78-abba-1a978d0e85f5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:03.660116 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a2c6e6e9-34f9-4d78-abba-1a978d0e85f5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:03.666707 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2c6e6e9-34f9-4d78-abba-1a978d0e85f5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:03.667160 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2c6e6e9-34f9-4d78-abba-1a978d0e85f5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:03.667933 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2c6e6e9-34f9-4d78-abba-1a978d0e85f5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:03.668390 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a2c6e6e9-34f9-4d78-abba-1a978d0e85f5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:03.748693 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a2c6e6e9-34f9-4d78-abba-1a978d0e85f5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093495 Feb 21 01:40:03.749288 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 444/874] 10.222.0.90 () {58 vars in 1274 bytes} [Mon Feb 21 01:40:03 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:40:03.810198 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c36d0bdd-007c-4ce6-898f-04836db6549f tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:03.810815 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c36d0bdd-007c-4ce6-898f-04836db6549f tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:03.816606 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c36d0bdd-007c-4ce6-898f-04836db6549f tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:03.817058 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c36d0bdd-007c-4ce6-898f-04836db6549f tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:03.817831 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c36d0bdd-007c-4ce6-898f-04836db6549f tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:03.818266 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c36d0bdd-007c-4ce6-898f-04836db6549f tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:04.328695 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c36d0bdd-007c-4ce6-898f-04836db6549f tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:04.336049 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c36d0bdd-007c-4ce6-898f-04836db6549f tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1575 microversion: 2.1 time: 0.529535 Feb 21 01:40:04.336645 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 431/875] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:03 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1575 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:05.066337 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f3c682a6-f55b-442a-82ef-a6922fe1641e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:05.066883 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f3c682a6-f55b-442a-82ef-a6922fe1641e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:05.073243 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-d7781538-898c-43b9-b923-07c7b374c3ab req-1d14d08a-40c7-4a53-bf31-09f7f7f5cab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ebd735-bf6a-4bf3-a66f-e1760c542440", "tag": "1586cbad-a660-482d-a053-cbacd581a4bd"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:40:05.074000 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3c682a6-f55b-442a-82ef-a6922fe1641e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:05.074000 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3c682a6-f55b-442a-82ef-a6922fe1641e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:05.074540 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3c682a6-f55b-442a-82ef-a6922fe1641e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:05.074971 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f3c682a6-f55b-442a-82ef-a6922fe1641e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:05.077407 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:40:05.077407 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:40:05.086285 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d7781538-898c-43b9-b923-07c7b374c3ab req-1d14d08a-40c7-4a53-bf31-09f7f7f5cab9 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:05.087017 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d7781538-898c-43b9-b923-07c7b374c3ab req-1d14d08a-40c7-4a53-bf31-09f7f7f5cab9 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:05.102702 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f3c682a6-f55b-442a-82ef-a6922fe1641e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440/ips" status: 200 len: 107 microversion: 2.1 time: 0.040749 Feb 21 01:40:05.104058 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 445/876] 10.222.0.90 () {58 vars in 1247 bytes} [Mon Feb 21 01:40:05 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440/ips => generated 107 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:40:05.112071 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-d7781538-898c-43b9-b923-07c7b374c3ab req-1d14d08a-40c7-4a53-bf31-09f7f7f5cab9 service nova] Creating event network-changed:1586cbad-a660-482d-a053-cbacd581a4bd for instance 17ebd735-bf6a-4bf3-a66f-e1760c542440 on hv-cinder-81322 Feb 21 01:40:05.117727 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-d7781538-898c-43b9-b923-07c7b374c3ab req-1d14d08a-40c7-4a53-bf31-09f7f7f5cab9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053358 Feb 21 01:40:05.118977 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 432/877] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:40:05.354441 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fc1195b9-155f-417e-9079-93bd460d3fbc tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:05.355168 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fc1195b9-155f-417e-9079-93bd460d3fbc tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:05.361684 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc1195b9-155f-417e-9079-93bd460d3fbc tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:05.362144 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc1195b9-155f-417e-9079-93bd460d3fbc tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:05.362930 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc1195b9-155f-417e-9079-93bd460d3fbc tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:05.363531 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fc1195b9-155f-417e-9079-93bd460d3fbc tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:05.617990 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-fc1195b9-155f-417e-9079-93bd460d3fbc tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:05.626069 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fc1195b9-155f-417e-9079-93bd460d3fbc tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1562 microversion: 2.1 time: 0.276292 Feb 21 01:40:05.626683 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 446/878] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:40:05 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1562 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:40:06.676909 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ef330602-424a-45c4-9823-61f506dfd700 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33e8ab94-c4bb-4def-b92e-4989c0335dfb"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:40:06.717675 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ef330602-424a-45c4-9823-61f506dfd700 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:06.717675 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef330602-424a-45c4-9823-61f506dfd700 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:06.717675 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef330602-424a-45c4-9823-61f506dfd700 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:06.717675 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef330602-424a-45c4-9823-61f506dfd700 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:06.718322 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef330602-424a-45c4-9823-61f506dfd700 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:07.416351 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ef330602-424a-45c4-9823-61f506dfd700 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "POST /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.744792 Feb 21 01:40:07.417005 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 433/879] 10.222.0.90 () {60 vars in 1322 bytes} [Mon Feb 21 01:40:06 2022] POST /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440/os-volume_attachments => generated 194 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:40:14.893072 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-148fd2e6-9fe7-4b03-9a5c-8d85f803e544 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:14.894006 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-148fd2e6-9fe7-4b03-9a5c-8d85f803e544 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:14.899693 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-148fd2e6-9fe7-4b03-9a5c-8d85f803e544 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:14.900778 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-148fd2e6-9fe7-4b03-9a5c-8d85f803e544 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:14.901547 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-148fd2e6-9fe7-4b03-9a5c-8d85f803e544 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:14.901980 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-148fd2e6-9fe7-4b03-9a5c-8d85f803e544 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:14.930024 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-148fd2e6-9fe7-4b03-9a5c-8d85f803e544 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040876 Feb 21 01:40:14.930575 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 447/880] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:40:14 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:40:14.941798 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-775fb2d2-0175-4d0c-91bb-ff112d0ad7e5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:14.942409 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-775fb2d2-0175-4d0c-91bb-ff112d0ad7e5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:14.949471 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-775fb2d2-0175-4d0c-91bb-ff112d0ad7e5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:14.949927 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-775fb2d2-0175-4d0c-91bb-ff112d0ad7e5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:14.950707 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-775fb2d2-0175-4d0c-91bb-ff112d0ad7e5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:14.951169 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-775fb2d2-0175-4d0c-91bb-ff112d0ad7e5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:14.980056 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-775fb2d2-0175-4d0c-91bb-ff112d0ad7e5 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440/os-volume_attachments/33e8ab94-c4bb-4def-b92e-4989c0335dfb" status: 200 len: 194 microversion: 2.1 time: 0.042860 Feb 21 01:40:14.980670 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 434/881] 10.222.0.90 () {58 vars in 1412 bytes} [Mon Feb 21 01:40:14 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440/os-volume_attachments/33e8ab94-c4bb-4def-b92e-4989c0335dfb => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:40:16.514423 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7d9ff034-72a8-4901-b6d7-731c319a5ec1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de2e173d-aec3-416c-adfe-916366a48b99"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:40:16.515396 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7d9ff034-72a8-4901-b6d7-731c319a5ec1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:16.521541 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d9ff034-72a8-4901-b6d7-731c319a5ec1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:16.521986 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d9ff034-72a8-4901-b6d7-731c319a5ec1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:16.522748 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d9ff034-72a8-4901-b6d7-731c319a5ec1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:16.523179 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7d9ff034-72a8-4901-b6d7-731c319a5ec1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:17.130048 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7d9ff034-72a8-4901-b6d7-731c319a5ec1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "POST /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.620108 Feb 21 01:40:17.131106 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 448/882] 10.222.0.90 () {60 vars in 1322 bytes} [Mon Feb 21 01:40:16 2022] POST /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440/os-volume_attachments => generated 194 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:40:25.637979 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1952a7d4-0100-44b3-9ae6-8850ef4aef36 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:25.638946 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1952a7d4-0100-44b3-9ae6-8850ef4aef36 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:25.645177 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1952a7d4-0100-44b3-9ae6-8850ef4aef36 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:25.645621 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1952a7d4-0100-44b3-9ae6-8850ef4aef36 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:25.646389 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1952a7d4-0100-44b3-9ae6-8850ef4aef36 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:25.646820 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1952a7d4-0100-44b3-9ae6-8850ef4aef36 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:25.675475 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1952a7d4-0100-44b3-9ae6-8850ef4aef36 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042160 Feb 21 01:40:25.676031 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 435/883] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:40:25 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:40:43.218137 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ff96be26-7522-438a-ba40-16ee7725fd81 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:40:43.218775 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ff96be26-7522-438a-ba40-16ee7725fd81 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:43.224909 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff96be26-7522-438a-ba40-16ee7725fd81 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:43.225360 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff96be26-7522-438a-ba40-16ee7725fd81 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:43.226136 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff96be26-7522-438a-ba40-16ee7725fd81 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:43.226571 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ff96be26-7522-438a-ba40-16ee7725fd81 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:43.248065 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-ff96be26-7522-438a-ba40-16ee7725fd81 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lazy-loading 'flavor' on Instance uuid 6e49ba09-7813-4190-b34c-c2a6fc9c49bb {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:40:43.849435 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ff96be26-7522-438a-ba40-16ee7725fd81 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "POST /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb/action" status: 202 len: 0 microversion: 2.20 time: 0.635684 Feb 21 01:40:43.850056 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 449/884] 10.222.0.90 () {62 vars in 1318 bytes} [Mon Feb 21 01:40:43 2022] POST /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb/action => generated 0 bytes in 637 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:40:43.860694 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bedacc50-4765-4136-911a-126e6888307d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:43.860694 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bedacc50-4765-4136-911a-126e6888307d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:43.865373 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bedacc50-4765-4136-911a-126e6888307d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:43.865823 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bedacc50-4765-4136-911a-126e6888307d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:43.866611 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bedacc50-4765-4136-911a-126e6888307d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:43.867042 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bedacc50-4765-4136-911a-126e6888307d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:44.011505 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-bedacc50-4765-4136-911a-126e6888307d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:44.019196 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-bedacc50-4765-4136-911a-126e6888307d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:44.020723 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-bedacc50-4765-4136-911a-126e6888307d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:44.021880 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bedacc50-4765-4136-911a-126e6888307d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1724 microversion: 2.20 time: 0.167126 Feb 21 01:40:44.022448 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 436/885] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:40:43 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:40:45.043282 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7031f691-b5c8-4847-9e78-070245f0ee55 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:45.044000 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7031f691-b5c8-4847-9e78-070245f0ee55 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:45.050211 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7031f691-b5c8-4847-9e78-070245f0ee55 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:45.050707 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7031f691-b5c8-4847-9e78-070245f0ee55 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:45.051510 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7031f691-b5c8-4847-9e78-070245f0ee55 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:45.051950 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7031f691-b5c8-4847-9e78-070245f0ee55 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:45.185864 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-7031f691-b5c8-4847-9e78-070245f0ee55 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:45.193673 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-7031f691-b5c8-4847-9e78-070245f0ee55 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:45.195206 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-7031f691-b5c8-4847-9e78-070245f0ee55 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:45.196347 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7031f691-b5c8-4847-9e78-070245f0ee55 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1724 microversion: 2.20 time: 0.158341 Feb 21 01:40:45.196927 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 450/886] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:40:45 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:40:46.214783 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-868cd7b5-c476-48cd-b426-0497682f706d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:46.215402 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-868cd7b5-c476-48cd-b426-0497682f706d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:46.221663 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-868cd7b5-c476-48cd-b426-0497682f706d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:46.222113 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-868cd7b5-c476-48cd-b426-0497682f706d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:46.222889 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-868cd7b5-c476-48cd-b426-0497682f706d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:46.223327 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-868cd7b5-c476-48cd-b426-0497682f706d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:46.351589 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-868cd7b5-c476-48cd-b426-0497682f706d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:46.359534 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-868cd7b5-c476-48cd-b426-0497682f706d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:46.361088 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-868cd7b5-c476-48cd-b426-0497682f706d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:46.362249 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-868cd7b5-c476-48cd-b426-0497682f706d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1724 microversion: 2.20 time: 0.151837 Feb 21 01:40:46.362807 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 437/887] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:40:46 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:40:47.379096 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-db55227a-b6dc-46ea-916e-a61b63b1936e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:47.379706 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-db55227a-b6dc-46ea-916e-a61b63b1936e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:47.386396 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db55227a-b6dc-46ea-916e-a61b63b1936e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:47.386847 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db55227a-b6dc-46ea-916e-a61b63b1936e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:47.387624 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db55227a-b6dc-46ea-916e-a61b63b1936e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:47.388059 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-db55227a-b6dc-46ea-916e-a61b63b1936e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:47.523384 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-db55227a-b6dc-46ea-916e-a61b63b1936e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:47.531675 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-db55227a-b6dc-46ea-916e-a61b63b1936e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:47.533214 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-db55227a-b6dc-46ea-916e-a61b63b1936e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:47.534373 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-db55227a-b6dc-46ea-916e-a61b63b1936e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1724 microversion: 2.20 time: 0.158978 Feb 21 01:40:47.534923 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 451/888] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:40:47 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:40:48.552210 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6457d71e-f534-4d04-a55b-3a86bb84d4de tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:48.552887 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6457d71e-f534-4d04-a55b-3a86bb84d4de tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:48.559736 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6457d71e-f534-4d04-a55b-3a86bb84d4de tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:48.560189 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6457d71e-f534-4d04-a55b-3a86bb84d4de tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:48.560996 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6457d71e-f534-4d04-a55b-3a86bb84d4de tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:48.561433 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6457d71e-f534-4d04-a55b-3a86bb84d4de tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:48.691591 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-6457d71e-f534-4d04-a55b-3a86bb84d4de tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:48.699308 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-6457d71e-f534-4d04-a55b-3a86bb84d4de tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:48.700855 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-6457d71e-f534-4d04-a55b-3a86bb84d4de tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:48.702167 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6457d71e-f534-4d04-a55b-3a86bb84d4de tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1724 microversion: 2.20 time: 0.153700 Feb 21 01:40:48.702729 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 438/889] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:40:48 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:40:49.720361 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-203a0e7e-6744-461a-af50-6fc040920813 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:49.721010 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-203a0e7e-6744-461a-af50-6fc040920813 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:49.727318 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-203a0e7e-6744-461a-af50-6fc040920813 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:49.727851 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-203a0e7e-6744-461a-af50-6fc040920813 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:49.728667 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-203a0e7e-6744-461a-af50-6fc040920813 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:49.729106 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-203a0e7e-6744-461a-af50-6fc040920813 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:49.856002 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-203a0e7e-6744-461a-af50-6fc040920813 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:49.863648 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-203a0e7e-6744-461a-af50-6fc040920813 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:49.865175 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-203a0e7e-6744-461a-af50-6fc040920813 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:49.866327 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-203a0e7e-6744-461a-af50-6fc040920813 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1724 microversion: 2.20 time: 0.149740 Feb 21 01:40:49.866880 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 452/890] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:40:49 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:40:50.884994 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fc3b388d-d5cc-4245-8fff-63cd80e7f841 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:50.885816 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fc3b388d-d5cc-4245-8fff-63cd80e7f841 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:50.894851 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc3b388d-d5cc-4245-8fff-63cd80e7f841 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:50.895294 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc3b388d-d5cc-4245-8fff-63cd80e7f841 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:50.896240 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc3b388d-d5cc-4245-8fff-63cd80e7f841 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:50.896723 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fc3b388d-d5cc-4245-8fff-63cd80e7f841 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:51.041850 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-fc3b388d-d5cc-4245-8fff-63cd80e7f841 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:51.049601 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-fc3b388d-d5cc-4245-8fff-63cd80e7f841 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:51.051105 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-fc3b388d-d5cc-4245-8fff-63cd80e7f841 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:51.052261 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fc3b388d-d5cc-4245-8fff-63cd80e7f841 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1724 microversion: 2.20 time: 0.171239 Feb 21 01:40:51.052851 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 439/891] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:40:50 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:40:52.069857 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-339ac19a-675a-4159-badc-350211d0ea81 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:52.070402 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-339ac19a-675a-4159-badc-350211d0ea81 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:52.076650 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-339ac19a-675a-4159-badc-350211d0ea81 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:52.077103 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-339ac19a-675a-4159-badc-350211d0ea81 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:52.077869 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-339ac19a-675a-4159-badc-350211d0ea81 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:52.078303 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-339ac19a-675a-4159-badc-350211d0ea81 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:52.205737 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-339ac19a-675a-4159-badc-350211d0ea81 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:52.213325 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-339ac19a-675a-4159-badc-350211d0ea81 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:52.214828 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-339ac19a-675a-4159-badc-350211d0ea81 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:52.215968 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-339ac19a-675a-4159-badc-350211d0ea81 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1724 microversion: 2.20 time: 0.149922 Feb 21 01:40:52.216543 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 453/892] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:40:52 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:40:53.234405 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c282ab2a-d35a-417c-9f8c-888200d1e824 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:53.235002 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c282ab2a-d35a-417c-9f8c-888200d1e824 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:53.241244 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c282ab2a-d35a-417c-9f8c-888200d1e824 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:53.241698 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c282ab2a-d35a-417c-9f8c-888200d1e824 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:53.242474 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c282ab2a-d35a-417c-9f8c-888200d1e824 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:53.242910 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c282ab2a-d35a-417c-9f8c-888200d1e824 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:53.391620 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c282ab2a-d35a-417c-9f8c-888200d1e824 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:53.399894 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c282ab2a-d35a-417c-9f8c-888200d1e824 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:53.401410 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c282ab2a-d35a-417c-9f8c-888200d1e824 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:53.402555 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c282ab2a-d35a-417c-9f8c-888200d1e824 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1724 microversion: 2.20 time: 0.171929 Feb 21 01:40:53.403101 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 440/893] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:40:53 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:40:54.420238 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-961dadf5-5bce-4b21-a716-770d11f8c529 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:54.420849 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-961dadf5-5bce-4b21-a716-770d11f8c529 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:54.427070 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-961dadf5-5bce-4b21-a716-770d11f8c529 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:54.427521 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-961dadf5-5bce-4b21-a716-770d11f8c529 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:54.428289 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-961dadf5-5bce-4b21-a716-770d11f8c529 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:54.428755 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-961dadf5-5bce-4b21-a716-770d11f8c529 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:54.556562 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-961dadf5-5bce-4b21-a716-770d11f8c529 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:54.564092 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-961dadf5-5bce-4b21-a716-770d11f8c529 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:54.565610 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-961dadf5-5bce-4b21-a716-770d11f8c529 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:54.566756 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-961dadf5-5bce-4b21-a716-770d11f8c529 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1724 microversion: 2.20 time: 0.150256 Feb 21 01:40:54.567343 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 454/894] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:40:54 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:40:55.584916 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0ef644da-44ca-426e-8e83-c858fa616f8e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:55.585511 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0ef644da-44ca-426e-8e83-c858fa616f8e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:55.591731 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ef644da-44ca-426e-8e83-c858fa616f8e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:55.592171 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ef644da-44ca-426e-8e83-c858fa616f8e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:55.592966 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ef644da-44ca-426e-8e83-c858fa616f8e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:55.593406 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0ef644da-44ca-426e-8e83-c858fa616f8e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:55.728982 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-0ef644da-44ca-426e-8e83-c858fa616f8e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:55.736727 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-0ef644da-44ca-426e-8e83-c858fa616f8e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:55.742560 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-0ef644da-44ca-426e-8e83-c858fa616f8e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:55.742560 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0ef644da-44ca-426e-8e83-c858fa616f8e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1724 microversion: 2.20 time: 0.158135 Feb 21 01:40:55.742560 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 441/895] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:40:55 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:40:56.757772 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6442e625-5dc3-49cd-bbff-4b2fe88c9284 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:56.758357 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6442e625-5dc3-49cd-bbff-4b2fe88c9284 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:56.765294 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6442e625-5dc3-49cd-bbff-4b2fe88c9284 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:56.765731 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6442e625-5dc3-49cd-bbff-4b2fe88c9284 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:56.766489 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6442e625-5dc3-49cd-bbff-4b2fe88c9284 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:56.766919 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6442e625-5dc3-49cd-bbff-4b2fe88c9284 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:56.894932 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-6442e625-5dc3-49cd-bbff-4b2fe88c9284 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:56.903167 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-6442e625-5dc3-49cd-bbff-4b2fe88c9284 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:56.904688 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-6442e625-5dc3-49cd-bbff-4b2fe88c9284 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:56.905821 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6442e625-5dc3-49cd-bbff-4b2fe88c9284 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1745 microversion: 2.20 time: 0.151791 Feb 21 01:40:56.906374 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 455/896] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:40:56 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:40:57.923749 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f28cb6ee-5c18-4d05-8c4a-ec5df7d9bf13 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:57.924278 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f28cb6ee-5c18-4d05-8c4a-ec5df7d9bf13 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:57.930974 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f28cb6ee-5c18-4d05-8c4a-ec5df7d9bf13 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:57.931415 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f28cb6ee-5c18-4d05-8c4a-ec5df7d9bf13 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:57.932177 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f28cb6ee-5c18-4d05-8c4a-ec5df7d9bf13 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:57.932630 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f28cb6ee-5c18-4d05-8c4a-ec5df7d9bf13 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:58.063930 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-f28cb6ee-5c18-4d05-8c4a-ec5df7d9bf13 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:58.071753 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-f28cb6ee-5c18-4d05-8c4a-ec5df7d9bf13 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:58.073305 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-f28cb6ee-5c18-4d05-8c4a-ec5df7d9bf13 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:58.074462 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f28cb6ee-5c18-4d05-8c4a-ec5df7d9bf13 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1745 microversion: 2.20 time: 0.154508 Feb 21 01:40:58.075017 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 442/897] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:40:57 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:40:59.091860 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d4d3bc3d-dce0-4abd-90bf-4183d8ff70ce tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:40:59.092409 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d4d3bc3d-dce0-4abd-90bf-4183d8ff70ce tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:40:59.098663 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4d3bc3d-dce0-4abd-90bf-4183d8ff70ce tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:59.099114 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4d3bc3d-dce0-4abd-90bf-4183d8ff70ce tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:59.099886 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4d3bc3d-dce0-4abd-90bf-4183d8ff70ce tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:59.100350 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4d3bc3d-dce0-4abd-90bf-4183d8ff70ce tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:59.237618 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-d4d3bc3d-dce0-4abd-90bf-4183d8ff70ce tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:59.245222 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-d4d3bc3d-dce0-4abd-90bf-4183d8ff70ce tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:59.246712 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-d4d3bc3d-dce0-4abd-90bf-4183d8ff70ce tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:40:59.247864 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d4d3bc3d-dce0-4abd-90bf-4183d8ff70ce tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1745 microversion: 2.20 time: 0.159796 Feb 21 01:40:59.248446 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 456/898] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:40:59 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:40:59.310802 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-6ef282ad-7a4b-4db8-acec-9ad57415d2c2 req-e5790afa-b2fe-49ec-b3b9-ecaf34ad4cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e49ba09-7813-4190-b34c-c2a6fc9c49bb", "name": "network-vif-plugged", "status": "completed", "tag": "f62f5ef9-41f3-4a8a-abf2-f89200d260f6"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:40:59.312327 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:40:59.312327 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:40:59.319562 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6ef282ad-7a4b-4db8-acec-9ad57415d2c2 req-e5790afa-b2fe-49ec-b3b9-ecaf34ad4cdc service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:40:59.320005 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6ef282ad-7a4b-4db8-acec-9ad57415d2c2 req-e5790afa-b2fe-49ec-b3b9-ecaf34ad4cdc service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:40:59.330703 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-6ef282ad-7a4b-4db8-acec-9ad57415d2c2 req-e5790afa-b2fe-49ec-b3b9-ecaf34ad4cdc service nova] Creating event network-vif-plugged:f62f5ef9-41f3-4a8a-abf2-f89200d260f6 for instance 6e49ba09-7813-4190-b34c-c2a6fc9c49bb on hv-cinder-81322 Feb 21 01:40:59.335834 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-6ef282ad-7a4b-4db8-acec-9ad57415d2c2 req-e5790afa-b2fe-49ec-b3b9-ecaf34ad4cdc service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028742 Feb 21 01:40:59.336417 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 443/899] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:41:00.266497 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-63b69eb3-b0d4-467f-9b06-053bac47d749 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:00.272648 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-63b69eb3-b0d4-467f-9b06-053bac47d749 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:00.273277 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63b69eb3-b0d4-467f-9b06-053bac47d749 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:00.273725 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63b69eb3-b0d4-467f-9b06-053bac47d749 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:00.274497 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63b69eb3-b0d4-467f-9b06-053bac47d749 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:00.274945 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-63b69eb3-b0d4-467f-9b06-053bac47d749 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:00.403694 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-63b69eb3-b0d4-467f-9b06-053bac47d749 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:00.411418 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-63b69eb3-b0d4-467f-9b06-053bac47d749 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:00.412941 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-63b69eb3-b0d4-467f-9b06-053bac47d749 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:00.414094 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-63b69eb3-b0d4-467f-9b06-053bac47d749 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1745 microversion: 2.20 time: 0.151288 Feb 21 01:41:00.414649 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 457/900] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:00 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:01.433836 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ac3742d6-07a2-4b84-9caa-ad77cef5ff26 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:01.434540 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ac3742d6-07a2-4b84-9caa-ad77cef5ff26 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:01.440657 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac3742d6-07a2-4b84-9caa-ad77cef5ff26 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:01.441109 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac3742d6-07a2-4b84-9caa-ad77cef5ff26 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:01.441894 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac3742d6-07a2-4b84-9caa-ad77cef5ff26 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:01.442330 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ac3742d6-07a2-4b84-9caa-ad77cef5ff26 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:01.587605 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ac3742d6-07a2-4b84-9caa-ad77cef5ff26 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:01.595931 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ac3742d6-07a2-4b84-9caa-ad77cef5ff26 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:01.597465 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ac3742d6-07a2-4b84-9caa-ad77cef5ff26 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:01.598624 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ac3742d6-07a2-4b84-9caa-ad77cef5ff26 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1740 microversion: 2.20 time: 0.169810 Feb 21 01:41:01.599209 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 444/901] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:01 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:02.619463 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b9bf5f15-3521-4783-877d-eb8040c397b9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:02.620068 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b9bf5f15-3521-4783-877d-eb8040c397b9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:02.627018 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9bf5f15-3521-4783-877d-eb8040c397b9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:02.627465 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9bf5f15-3521-4783-877d-eb8040c397b9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:02.628272 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9bf5f15-3521-4783-877d-eb8040c397b9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:02.628739 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9bf5f15-3521-4783-877d-eb8040c397b9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:02.791638 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b9bf5f15-3521-4783-877d-eb8040c397b9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:02.803411 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b9bf5f15-3521-4783-877d-eb8040c397b9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:02.805234 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b9bf5f15-3521-4783-877d-eb8040c397b9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:02.807278 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b9bf5f15-3521-4783-877d-eb8040c397b9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1740 microversion: 2.20 time: 0.193045 Feb 21 01:41:02.816943 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 458/902] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:02 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:03.827583 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b35154d4-1e7c-481e-9d03-696c48d36013 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:03.828558 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b35154d4-1e7c-481e-9d03-696c48d36013 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:03.840241 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b35154d4-1e7c-481e-9d03-696c48d36013 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:03.841044 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b35154d4-1e7c-481e-9d03-696c48d36013 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:03.842359 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b35154d4-1e7c-481e-9d03-696c48d36013 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:03.843095 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b35154d4-1e7c-481e-9d03-696c48d36013 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:04.004987 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-b35154d4-1e7c-481e-9d03-696c48d36013 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:04.014937 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-b35154d4-1e7c-481e-9d03-696c48d36013 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:04.016622 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-b35154d4-1e7c-481e-9d03-696c48d36013 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:04.017886 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b35154d4-1e7c-481e-9d03-696c48d36013 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1740 microversion: 2.20 time: 0.197339 Feb 21 01:41:04.018714 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 445/903] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:03 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:05.036211 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-86ecfacd-7e71-4b42-aba9-5ea738f46851 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:05.037543 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-86ecfacd-7e71-4b42-aba9-5ea738f46851 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:05.045139 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86ecfacd-7e71-4b42-aba9-5ea738f46851 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:05.045910 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86ecfacd-7e71-4b42-aba9-5ea738f46851 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:05.046912 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86ecfacd-7e71-4b42-aba9-5ea738f46851 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:05.047347 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-86ecfacd-7e71-4b42-aba9-5ea738f46851 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:05.201560 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-86ecfacd-7e71-4b42-aba9-5ea738f46851 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:05.210250 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-86ecfacd-7e71-4b42-aba9-5ea738f46851 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:05.211711 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-86ecfacd-7e71-4b42-aba9-5ea738f46851 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:05.213431 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-86ecfacd-7e71-4b42-aba9-5ea738f46851 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1740 microversion: 2.20 time: 0.181228 Feb 21 01:41:05.214513 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 459/904] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:05 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:06.230850 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-63b64427-3f22-42cb-b43c-512d5254e0df tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:06.231463 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-63b64427-3f22-42cb-b43c-512d5254e0df tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:06.238447 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63b64427-3f22-42cb-b43c-512d5254e0df tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:06.239034 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63b64427-3f22-42cb-b43c-512d5254e0df tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:06.239837 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63b64427-3f22-42cb-b43c-512d5254e0df tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:06.240273 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-63b64427-3f22-42cb-b43c-512d5254e0df tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:06.395633 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-63b64427-3f22-42cb-b43c-512d5254e0df tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:06.406143 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-63b64427-3f22-42cb-b43c-512d5254e0df tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:06.407658 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-63b64427-3f22-42cb-b43c-512d5254e0df tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:06.408911 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-63b64427-3f22-42cb-b43c-512d5254e0df tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1740 microversion: 2.20 time: 0.181725 Feb 21 01:41:06.409665 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 446/905] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:06 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:07.427719 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-256b0ad2-13cf-4178-b1cf-238e0e0d18dd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:07.428460 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-256b0ad2-13cf-4178-b1cf-238e0e0d18dd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:07.435170 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-256b0ad2-13cf-4178-b1cf-238e0e0d18dd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:07.435983 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-256b0ad2-13cf-4178-b1cf-238e0e0d18dd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:07.436367 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-256b0ad2-13cf-4178-b1cf-238e0e0d18dd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:07.436977 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-256b0ad2-13cf-4178-b1cf-238e0e0d18dd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:07.569461 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-256b0ad2-13cf-4178-b1cf-238e0e0d18dd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:07.577731 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-256b0ad2-13cf-4178-b1cf-238e0e0d18dd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:07.579225 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-256b0ad2-13cf-4178-b1cf-238e0e0d18dd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:07.580365 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-256b0ad2-13cf-4178-b1cf-238e0e0d18dd tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1740 microversion: 2.20 time: 0.156605 Feb 21 01:41:07.580948 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 460/906] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:07 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:08.598263 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9696e0ac-12fd-4709-8110-ab95f9639da9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:08.598927 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9696e0ac-12fd-4709-8110-ab95f9639da9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:08.610140 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9696e0ac-12fd-4709-8110-ab95f9639da9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:08.610587 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9696e0ac-12fd-4709-8110-ab95f9639da9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:08.611373 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9696e0ac-12fd-4709-8110-ab95f9639da9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:08.611803 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9696e0ac-12fd-4709-8110-ab95f9639da9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:08.772197 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-9696e0ac-12fd-4709-8110-ab95f9639da9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:08.781348 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-9696e0ac-12fd-4709-8110-ab95f9639da9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:08.783062 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-9696e0ac-12fd-4709-8110-ab95f9639da9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:08.784332 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9696e0ac-12fd-4709-8110-ab95f9639da9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1740 microversion: 2.20 time: 0.189759 Feb 21 01:41:08.785376 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 447/907] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:08 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:09.802538 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5325a042-9ef4-4577-9b32-21015a986109 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:09.803382 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5325a042-9ef4-4577-9b32-21015a986109 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:09.810806 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5325a042-9ef4-4577-9b32-21015a986109 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:09.811699 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5325a042-9ef4-4577-9b32-21015a986109 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:09.812906 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5325a042-9ef4-4577-9b32-21015a986109 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:09.813392 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5325a042-9ef4-4577-9b32-21015a986109 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:09.954458 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-5325a042-9ef4-4577-9b32-21015a986109 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:09.963152 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-5325a042-9ef4-4577-9b32-21015a986109 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:09.964731 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-5325a042-9ef4-4577-9b32-21015a986109 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:09.966118 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5325a042-9ef4-4577-9b32-21015a986109 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1740 microversion: 2.20 time: 0.167432 Feb 21 01:41:09.966688 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 461/908] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:09 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:10.983800 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1ffca64b-de8f-4fe0-a178-2b25135a3d82 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:10.984347 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1ffca64b-de8f-4fe0-a178-2b25135a3d82 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:10.992762 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ffca64b-de8f-4fe0-a178-2b25135a3d82 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:10.993798 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ffca64b-de8f-4fe0-a178-2b25135a3d82 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:10.994673 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ffca64b-de8f-4fe0-a178-2b25135a3d82 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:10.995109 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ffca64b-de8f-4fe0-a178-2b25135a3d82 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:11.132075 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-1ffca64b-de8f-4fe0-a178-2b25135a3d82 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:11.141837 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-1ffca64b-de8f-4fe0-a178-2b25135a3d82 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:11.143360 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-1ffca64b-de8f-4fe0-a178-2b25135a3d82 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:11.144584 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1ffca64b-de8f-4fe0-a178-2b25135a3d82 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1740 microversion: 2.20 time: 0.164494 Feb 21 01:41:11.145297 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 448/909] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:10 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:12.163243 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-196b6982-422e-4e36-99bc-b0c2a04d33ac tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:12.163855 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-196b6982-422e-4e36-99bc-b0c2a04d33ac tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:12.170130 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-196b6982-422e-4e36-99bc-b0c2a04d33ac tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:12.170578 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-196b6982-422e-4e36-99bc-b0c2a04d33ac tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:12.171348 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-196b6982-422e-4e36-99bc-b0c2a04d33ac tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:12.171780 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-196b6982-422e-4e36-99bc-b0c2a04d33ac tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:12.300221 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-196b6982-422e-4e36-99bc-b0c2a04d33ac tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:12.308568 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-196b6982-422e-4e36-99bc-b0c2a04d33ac tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:12.310106 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-196b6982-422e-4e36-99bc-b0c2a04d33ac tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:12.311308 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-196b6982-422e-4e36-99bc-b0c2a04d33ac tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1740 microversion: 2.20 time: 0.151772 Feb 21 01:41:12.311879 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 462/910] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:12 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1740 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:13.329195 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ab202ce7-871e-473e-9cff-d93651ccd198 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:13.329799 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ab202ce7-871e-473e-9cff-d93651ccd198 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:13.335904 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab202ce7-871e-473e-9cff-d93651ccd198 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:13.336336 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab202ce7-871e-473e-9cff-d93651ccd198 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:13.337776 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab202ce7-871e-473e-9cff-d93651ccd198 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:13.338199 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab202ce7-871e-473e-9cff-d93651ccd198 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:13.499418 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ab202ce7-871e-473e-9cff-d93651ccd198 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:13.508224 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ab202ce7-871e-473e-9cff-d93651ccd198 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:13.510415 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ab202ce7-871e-473e-9cff-d93651ccd198 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:13.511887 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ab202ce7-871e-473e-9cff-d93651ccd198 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1722 microversion: 2.20 time: 0.186405 Feb 21 01:41:13.512503 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 449/911] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:13 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:14.530125 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f19f9560-28b9-4c5f-aa81-6480d07d04d5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:14.530663 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f19f9560-28b9-4c5f-aa81-6480d07d04d5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:14.536990 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f19f9560-28b9-4c5f-aa81-6480d07d04d5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:14.537441 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f19f9560-28b9-4c5f-aa81-6480d07d04d5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:14.538220 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f19f9560-28b9-4c5f-aa81-6480d07d04d5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:14.538654 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f19f9560-28b9-4c5f-aa81-6480d07d04d5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:14.668112 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-f19f9560-28b9-4c5f-aa81-6480d07d04d5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:14.677373 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-f19f9560-28b9-4c5f-aa81-6480d07d04d5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:14.678876 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-f19f9560-28b9-4c5f-aa81-6480d07d04d5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:14.680031 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f19f9560-28b9-4c5f-aa81-6480d07d04d5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1722 microversion: 2.20 time: 0.153713 Feb 21 01:41:14.680625 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 463/912] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:14 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:15.698029 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-62de6b0e-7454-45f2-acb5-962cc0acf0bb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:15.698650 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-62de6b0e-7454-45f2-acb5-962cc0acf0bb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:15.705855 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62de6b0e-7454-45f2-acb5-962cc0acf0bb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:15.705855 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62de6b0e-7454-45f2-acb5-962cc0acf0bb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:15.706345 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62de6b0e-7454-45f2-acb5-962cc0acf0bb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:15.706786 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-62de6b0e-7454-45f2-acb5-962cc0acf0bb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:15.842966 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-62de6b0e-7454-45f2-acb5-962cc0acf0bb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:15.850728 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-62de6b0e-7454-45f2-acb5-962cc0acf0bb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:15.852213 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-62de6b0e-7454-45f2-acb5-962cc0acf0bb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:15.853380 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-62de6b0e-7454-45f2-acb5-962cc0acf0bb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1665 microversion: 2.20 time: 0.159928 Feb 21 01:41:15.853930 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 450/913] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:15 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1665 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:15.873187 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-37092deb-a022-41bd-ad69-362fe62a5c36 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43588344-daeb-4552-abc4-fa0792818ed3"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:41:15.874233 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-37092deb-a022-41bd-ad69-362fe62a5c36 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:15.880363 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37092deb-a022-41bd-ad69-362fe62a5c36 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:15.880841 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37092deb-a022-41bd-ad69-362fe62a5c36 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:15.881600 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37092deb-a022-41bd-ad69-362fe62a5c36 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:15.882027 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-37092deb-a022-41bd-ad69-362fe62a5c36 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:16.810608 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-37092deb-a022-41bd-ad69-362fe62a5c36 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "POST /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.941150 Feb 21 01:41:16.811138 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 464/914] 10.222.0.90 () {62 vars in 1363 bytes} [Mon Feb 21 01:41:15 2022] POST /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb/os-volume_attachments => generated 188 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 21 01:41:17.069254 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4f085e61-a5e3-428a-a605-970dc623734d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:17.069692 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4f085e61-a5e3-428a-a605-970dc623734d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:17.076358 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f085e61-a5e3-428a-a605-970dc623734d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:17.076838 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f085e61-a5e3-428a-a605-970dc623734d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:17.077612 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f085e61-a5e3-428a-a605-970dc623734d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:17.078045 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4f085e61-a5e3-428a-a605-970dc623734d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:17.301063 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-19d91d10-e078-4970-ab50-842c86cd459e req-2a45201a-1330-4347-8550-b4a8cfc029da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e49ba09-7813-4190-b34c-c2a6fc9c49bb", "name": "network-vif-unplugged", "status": "completed", "tag": "f62f5ef9-41f3-4a8a-abf2-f89200d260f6"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:41:17.302690 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:41:17.302690 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:41:17.311296 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-19d91d10-e078-4970-ab50-842c86cd459e req-2a45201a-1330-4347-8550-b4a8cfc029da service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:17.311759 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-19d91d10-e078-4970-ab50-842c86cd459e req-2a45201a-1330-4347-8550-b4a8cfc029da service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:17.323445 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.compute.server_external_events [req-19d91d10-e078-4970-ab50-842c86cd459e req-2a45201a-1330-4347-8550-b4a8cfc029da service nova] Unable to find a host for instance 6e49ba09-7813-4190-b34c-c2a6fc9c49bb. Dropping event network-vif-unplugged {{(pid=123541) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 21 01:41:17.323445 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-19d91d10-e078-4970-ab50-842c86cd459e req-2a45201a-1330-4347-8550-b4a8cfc029da service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026264 Feb 21 01:41:17.324038 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 465/915] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Feb 21 01:41:17.662224 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4f085e61-a5e3-428a-a605-970dc623734d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "DELETE /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb/os-volume_attachments/43588344-daeb-4552-abc4-fa0792818ed3" status: 202 len: 0 microversion: 2.20 time: 0.596664 Feb 21 01:41:17.662846 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 451/916] 10.222.0.90 () {60 vars in 1456 bytes} [Mon Feb 21 01:41:17 2022] DELETE /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb/os-volume_attachments/43588344-daeb-4552-abc4-fa0792818ed3 => generated 0 bytes in 598 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:41:17.729818 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-70d563c6-c2e2-45be-98b6-261ec309fb1c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:41:17.730376 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-70d563c6-c2e2-45be-98b6-261ec309fb1c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:17.736211 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-70d563c6-c2e2-45be-98b6-261ec309fb1c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:17.736799 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-70d563c6-c2e2-45be-98b6-261ec309fb1c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:17.737589 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-70d563c6-c2e2-45be-98b6-261ec309fb1c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:17.738024 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-70d563c6-c2e2-45be-98b6-261ec309fb1c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:17.950349 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-70d563c6-c2e2-45be-98b6-261ec309fb1c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "POST /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb/action" status: 202 len: 0 microversion: 2.20 time: 0.224578 Feb 21 01:41:17.950910 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 466/917] 10.222.0.90 () {62 vars in 1318 bytes} [Mon Feb 21 01:41:17 2022] POST /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:41:17.958891 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-35db7911-78c8-4609-ada8-e067e1245ec5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:17.959633 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-35db7911-78c8-4609-ada8-e067e1245ec5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:17.966470 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35db7911-78c8-4609-ada8-e067e1245ec5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:17.966916 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35db7911-78c8-4609-ada8-e067e1245ec5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:17.967743 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35db7911-78c8-4609-ada8-e067e1245ec5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:17.968170 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-35db7911-78c8-4609-ada8-e067e1245ec5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:18.103885 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-35db7911-78c8-4609-ada8-e067e1245ec5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:18.111666 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-35db7911-78c8-4609-ada8-e067e1245ec5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:18.113212 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-35db7911-78c8-4609-ada8-e067e1245ec5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:18.114379 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-35db7911-78c8-4609-ada8-e067e1245ec5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1673 microversion: 2.20 time: 0.159224 Feb 21 01:41:18.114957 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 452/918] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:17 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:41:19.132597 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-38b57b34-eba8-4801-83a4-a0e265bc6a0b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:19.133236 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-38b57b34-eba8-4801-83a4-a0e265bc6a0b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:19.139833 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38b57b34-eba8-4801-83a4-a0e265bc6a0b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:19.140288 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38b57b34-eba8-4801-83a4-a0e265bc6a0b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:19.141134 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38b57b34-eba8-4801-83a4-a0e265bc6a0b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:19.141578 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-38b57b34-eba8-4801-83a4-a0e265bc6a0b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:19.278105 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-38b57b34-eba8-4801-83a4-a0e265bc6a0b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:19.287374 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-38b57b34-eba8-4801-83a4-a0e265bc6a0b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:19.289125 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-38b57b34-eba8-4801-83a4-a0e265bc6a0b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:19.290944 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-38b57b34-eba8-4801-83a4-a0e265bc6a0b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1673 microversion: 2.20 time: 0.162198 Feb 21 01:41:19.291586 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 467/919] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:19 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:20.316907 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2b632f50-656c-48fa-89cb-b40cd211da86 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:20.316907 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2b632f50-656c-48fa-89cb-b40cd211da86 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:20.322935 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b632f50-656c-48fa-89cb-b40cd211da86 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:20.323396 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b632f50-656c-48fa-89cb-b40cd211da86 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:20.324194 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b632f50-656c-48fa-89cb-b40cd211da86 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:20.324660 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2b632f50-656c-48fa-89cb-b40cd211da86 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:20.479823 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-2b632f50-656c-48fa-89cb-b40cd211da86 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:20.482924 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-2b632f50-656c-48fa-89cb-b40cd211da86 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:20.484408 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-2b632f50-656c-48fa-89cb-b40cd211da86 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:20.486115 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2b632f50-656c-48fa-89cb-b40cd211da86 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1731 microversion: 2.20 time: 0.174935 Feb 21 01:41:20.486242 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 453/920] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:20 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:21.504387 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-edcb701f-7405-471e-88d5-e75d51c9077f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:21.505031 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-edcb701f-7405-471e-88d5-e75d51c9077f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:21.512562 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-edcb701f-7405-471e-88d5-e75d51c9077f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:21.513018 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-edcb701f-7405-471e-88d5-e75d51c9077f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:21.513961 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-edcb701f-7405-471e-88d5-e75d51c9077f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:21.514538 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-edcb701f-7405-471e-88d5-e75d51c9077f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:21.655857 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-edcb701f-7405-471e-88d5-e75d51c9077f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:21.664276 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-edcb701f-7405-471e-88d5-e75d51c9077f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:21.666649 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-edcb701f-7405-471e-88d5-e75d51c9077f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:21.668676 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-edcb701f-7405-471e-88d5-e75d51c9077f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1731 microversion: 2.20 time: 0.168008 Feb 21 01:41:21.669794 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 468/921] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:21 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:22.686935 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9e791c5a-7d51-4401-87f0-7115fc7f30d4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:22.687569 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9e791c5a-7d51-4401-87f0-7115fc7f30d4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:22.703076 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e791c5a-7d51-4401-87f0-7115fc7f30d4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:22.703577 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e791c5a-7d51-4401-87f0-7115fc7f30d4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:22.704452 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e791c5a-7d51-4401-87f0-7115fc7f30d4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:22.705022 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9e791c5a-7d51-4401-87f0-7115fc7f30d4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:22.858261 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-9e791c5a-7d51-4401-87f0-7115fc7f30d4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:22.866349 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-9e791c5a-7d51-4401-87f0-7115fc7f30d4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:22.868511 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-9e791c5a-7d51-4401-87f0-7115fc7f30d4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:22.878237 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9e791c5a-7d51-4401-87f0-7115fc7f30d4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1731 microversion: 2.20 time: 0.194909 Feb 21 01:41:22.879035 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 454/922] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:22 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:23.896872 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-afe93b9e-0e40-4c31-a9f5-e5dc43b689ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:23.897396 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-afe93b9e-0e40-4c31-a9f5-e5dc43b689ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:23.903682 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-afe93b9e-0e40-4c31-a9f5-e5dc43b689ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:23.904135 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-afe93b9e-0e40-4c31-a9f5-e5dc43b689ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:23.904949 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-afe93b9e-0e40-4c31-a9f5-e5dc43b689ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:23.905385 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-afe93b9e-0e40-4c31-a9f5-e5dc43b689ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:24.042663 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-afe93b9e-0e40-4c31-a9f5-e5dc43b689ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:24.050399 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-afe93b9e-0e40-4c31-a9f5-e5dc43b689ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:24.051917 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-afe93b9e-0e40-4c31-a9f5-e5dc43b689ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:24.053111 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-afe93b9e-0e40-4c31-a9f5-e5dc43b689ea tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1731 microversion: 2.20 time: 0.160006 Feb 21 01:41:24.053861 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 469/923] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:23 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:25.071078 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1127bd1f-6fc2-4da5-ba84-1dec77b52193 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:25.071668 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1127bd1f-6fc2-4da5-ba84-1dec77b52193 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:25.077997 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1127bd1f-6fc2-4da5-ba84-1dec77b52193 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:25.078450 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1127bd1f-6fc2-4da5-ba84-1dec77b52193 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:25.079232 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1127bd1f-6fc2-4da5-ba84-1dec77b52193 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:25.079669 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1127bd1f-6fc2-4da5-ba84-1dec77b52193 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:25.214546 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-1127bd1f-6fc2-4da5-ba84-1dec77b52193 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:25.223032 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-1127bd1f-6fc2-4da5-ba84-1dec77b52193 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:25.224562 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-1127bd1f-6fc2-4da5-ba84-1dec77b52193 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:25.225728 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1127bd1f-6fc2-4da5-ba84-1dec77b52193 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1731 microversion: 2.20 time: 0.158450 Feb 21 01:41:25.226289 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 455/924] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:25 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:26.244696 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-31557722-8918-4518-a2db-9899deadea7c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:26.245333 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-31557722-8918-4518-a2db-9899deadea7c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:26.251607 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31557722-8918-4518-a2db-9899deadea7c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:26.252059 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31557722-8918-4518-a2db-9899deadea7c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:26.252878 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31557722-8918-4518-a2db-9899deadea7c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:26.253315 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-31557722-8918-4518-a2db-9899deadea7c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:26.392598 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-31557722-8918-4518-a2db-9899deadea7c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:26.400250 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-31557722-8918-4518-a2db-9899deadea7c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:26.401774 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-31557722-8918-4518-a2db-9899deadea7c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:26.403020 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-31557722-8918-4518-a2db-9899deadea7c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1731 microversion: 2.20 time: 0.162481 Feb 21 01:41:26.403583 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 470/925] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:26 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:27.422317 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c1432860-ed68-4b7d-bf0c-1ad9042e080c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:27.422933 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c1432860-ed68-4b7d-bf0c-1ad9042e080c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:27.429182 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c1432860-ed68-4b7d-bf0c-1ad9042e080c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:27.429636 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c1432860-ed68-4b7d-bf0c-1ad9042e080c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:27.431079 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c1432860-ed68-4b7d-bf0c-1ad9042e080c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:27.431519 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c1432860-ed68-4b7d-bf0c-1ad9042e080c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:27.571653 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c1432860-ed68-4b7d-bf0c-1ad9042e080c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:27.579359 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c1432860-ed68-4b7d-bf0c-1ad9042e080c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:27.580883 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c1432860-ed68-4b7d-bf0c-1ad9042e080c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:27.582037 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c1432860-ed68-4b7d-bf0c-1ad9042e080c tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1731 microversion: 2.20 time: 0.163446 Feb 21 01:41:27.582600 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 456/926] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:27 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:28.601166 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-447bd711-681e-457b-a43f-e23c380216bb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:28.602463 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-447bd711-681e-457b-a43f-e23c380216bb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:28.620809 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-447bd711-681e-457b-a43f-e23c380216bb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:28.621409 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-447bd711-681e-457b-a43f-e23c380216bb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:28.622222 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-447bd711-681e-457b-a43f-e23c380216bb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:28.622660 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-447bd711-681e-457b-a43f-e23c380216bb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:28.774924 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-447bd711-681e-457b-a43f-e23c380216bb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:28.782679 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-447bd711-681e-457b-a43f-e23c380216bb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:28.784389 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-447bd711-681e-457b-a43f-e23c380216bb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:28.785707 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-447bd711-681e-457b-a43f-e23c380216bb tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1731 microversion: 2.20 time: 0.188859 Feb 21 01:41:28.786339 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 471/927] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:28 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:29.804193 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6cbccc2e-fdc3-4713-83af-272e684a0b22 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:29.805495 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6cbccc2e-fdc3-4713-83af-272e684a0b22 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:29.815019 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cbccc2e-fdc3-4713-83af-272e684a0b22 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:29.815474 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cbccc2e-fdc3-4713-83af-272e684a0b22 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:29.816903 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cbccc2e-fdc3-4713-83af-272e684a0b22 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:29.817341 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6cbccc2e-fdc3-4713-83af-272e684a0b22 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:29.962874 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-6cbccc2e-fdc3-4713-83af-272e684a0b22 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:29.971494 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-6cbccc2e-fdc3-4713-83af-272e684a0b22 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:29.973023 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-6cbccc2e-fdc3-4713-83af-272e684a0b22 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:29.974252 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6cbccc2e-fdc3-4713-83af-272e684a0b22 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1731 microversion: 2.20 time: 0.173769 Feb 21 01:41:29.974810 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 457/928] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:29 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:30.992824 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1bc65df2-817c-4327-8a32-371fc61861e1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:30.993507 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1bc65df2-817c-4327-8a32-371fc61861e1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:30.999619 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1bc65df2-817c-4327-8a32-371fc61861e1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:31.000069 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1bc65df2-817c-4327-8a32-371fc61861e1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:31.000895 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1bc65df2-817c-4327-8a32-371fc61861e1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:31.001330 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1bc65df2-817c-4327-8a32-371fc61861e1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:31.133153 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1bc65df2-817c-4327-8a32-371fc61861e1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:31.141094 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1bc65df2-817c-4327-8a32-371fc61861e1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:31.142600 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1bc65df2-817c-4327-8a32-371fc61861e1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:31.143745 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1bc65df2-817c-4327-8a32-371fc61861e1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1731 microversion: 2.20 time: 0.155180 Feb 21 01:41:31.144296 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 472/929] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:30 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:32.161341 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-276298a0-2719-4c8a-9a54-005699e378fa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:32.161884 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-276298a0-2719-4c8a-9a54-005699e378fa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:32.168022 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-276298a0-2719-4c8a-9a54-005699e378fa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:32.168485 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-276298a0-2719-4c8a-9a54-005699e378fa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:32.169253 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-276298a0-2719-4c8a-9a54-005699e378fa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:32.169683 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-276298a0-2719-4c8a-9a54-005699e378fa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:32.298038 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-276298a0-2719-4c8a-9a54-005699e378fa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:32.306147 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-276298a0-2719-4c8a-9a54-005699e378fa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:32.309425 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-276298a0-2719-4c8a-9a54-005699e378fa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:32.309425 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-276298a0-2719-4c8a-9a54-005699e378fa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1731 microversion: 2.20 time: 0.151381 Feb 21 01:41:32.312872 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 458/930] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:32 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:33.326642 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3e5a7b6c-5a42-4328-a6ec-fce2796decb4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:33.327254 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3e5a7b6c-5a42-4328-a6ec-fce2796decb4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:33.333534 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e5a7b6c-5a42-4328-a6ec-fce2796decb4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:33.333985 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e5a7b6c-5a42-4328-a6ec-fce2796decb4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:33.334904 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e5a7b6c-5a42-4328-a6ec-fce2796decb4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:33.335338 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3e5a7b6c-5a42-4328-a6ec-fce2796decb4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:33.466983 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-3e5a7b6c-5a42-4328-a6ec-fce2796decb4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:33.474658 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-3e5a7b6c-5a42-4328-a6ec-fce2796decb4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:33.476148 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-3e5a7b6c-5a42-4328-a6ec-fce2796decb4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:33.477891 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3e5a7b6c-5a42-4328-a6ec-fce2796decb4 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1731 microversion: 2.20 time: 0.155001 Feb 21 01:41:33.478450 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 473/931] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:33 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:34.495687 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-dd2319e2-cc13-4b6f-90a8-f020cc381632 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:34.496308 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-dd2319e2-cc13-4b6f-90a8-f020cc381632 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:34.502349 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd2319e2-cc13-4b6f-90a8-f020cc381632 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:34.502806 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd2319e2-cc13-4b6f-90a8-f020cc381632 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:34.503581 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd2319e2-cc13-4b6f-90a8-f020cc381632 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:34.504018 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-dd2319e2-cc13-4b6f-90a8-f020cc381632 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:34.640528 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-dd2319e2-cc13-4b6f-90a8-f020cc381632 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:34.649955 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-dd2319e2-cc13-4b6f-90a8-f020cc381632 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:34.653268 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-dd2319e2-cc13-4b6f-90a8-f020cc381632 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:34.653268 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-dd2319e2-cc13-4b6f-90a8-f020cc381632 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1731 microversion: 2.20 time: 0.161423 Feb 21 01:41:34.653268 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 459/932] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:34 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:34.677755 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-00e1a7c2-912c-4f78-8214-07edaeac8619 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:34.678292 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-00e1a7c2-912c-4f78-8214-07edaeac8619 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:34.685158 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-00e1a7c2-912c-4f78-8214-07edaeac8619 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:34.685633 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-00e1a7c2-912c-4f78-8214-07edaeac8619 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:34.686395 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-00e1a7c2-912c-4f78-8214-07edaeac8619 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:34.686825 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-00e1a7c2-912c-4f78-8214-07edaeac8619 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:34.714951 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-00e1a7c2-912c-4f78-8214-07edaeac8619 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440/os-volume_attachments/33e8ab94-c4bb-4def-b92e-4989c0335dfb" status: 200 len: 194 microversion: 2.1 time: 0.040868 Feb 21 01:41:34.715549 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 474/933] 10.222.0.90 () {58 vars in 1412 bytes} [Mon Feb 21 01:41:34 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440/os-volume_attachments/33e8ab94-c4bb-4def-b92e-4989c0335dfb => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:41:34.725957 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-f7f691f4-dc5e-4eb2-8324-cdd4c42f0a4e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:34.726457 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-f7f691f4-dc5e-4eb2-8324-cdd4c42f0a4e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:34.732748 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7f691f4-dc5e-4eb2-8324-cdd4c42f0a4e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:34.733203 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7f691f4-dc5e-4eb2-8324-cdd4c42f0a4e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:34.734002 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7f691f4-dc5e-4eb2-8324-cdd4c42f0a4e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:34.734469 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-f7f691f4-dc5e-4eb2-8324-cdd4c42f0a4e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:34.810582 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-f7f691f4-dc5e-4eb2-8324-cdd4c42f0a4e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lazy-loading 'services' on Instance uuid 17ebd735-bf6a-4bf3-a66f-e1760c542440 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:41:35.004641 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-f7f691f4-dc5e-4eb2-8324-cdd4c42f0a4e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "DELETE /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440/os-volume_attachments/33e8ab94-c4bb-4def-b92e-4989c0335dfb" status: 202 len: 0 microversion: 2.1 time: 0.282263 Feb 21 01:41:35.005243 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 460/934] 10.222.0.90 () {58 vars in 1415 bytes} [Mon Feb 21 01:41:34 2022] DELETE /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440/os-volume_attachments/33e8ab94-c4bb-4def-b92e-4989c0335dfb => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:41:35.670783 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4217102b-4519-42c1-9ac6-0c0e3345c29d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:35.671427 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4217102b-4519-42c1-9ac6-0c0e3345c29d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:35.677371 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4217102b-4519-42c1-9ac6-0c0e3345c29d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:35.677819 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4217102b-4519-42c1-9ac6-0c0e3345c29d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:35.678598 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4217102b-4519-42c1-9ac6-0c0e3345c29d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:35.679033 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4217102b-4519-42c1-9ac6-0c0e3345c29d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:35.809629 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-4217102b-4519-42c1-9ac6-0c0e3345c29d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:35.817383 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-4217102b-4519-42c1-9ac6-0c0e3345c29d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:35.818894 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-4217102b-4519-42c1-9ac6-0c0e3345c29d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:35.820043 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4217102b-4519-42c1-9ac6-0c0e3345c29d tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1731 microversion: 2.20 time: 0.152999 Feb 21 01:41:35.820627 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 475/935] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:35 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:36.838908 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e462c95a-8b52-423f-aabf-5dfff8beafc0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:36.839612 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e462c95a-8b52-423f-aabf-5dfff8beafc0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:36.845709 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e462c95a-8b52-423f-aabf-5dfff8beafc0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:36.846157 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e462c95a-8b52-423f-aabf-5dfff8beafc0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:36.846962 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e462c95a-8b52-423f-aabf-5dfff8beafc0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:36.847399 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e462c95a-8b52-423f-aabf-5dfff8beafc0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:36.981452 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-e462c95a-8b52-423f-aabf-5dfff8beafc0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:36.989169 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-e462c95a-8b52-423f-aabf-5dfff8beafc0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:36.990674 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-e462c95a-8b52-423f-aabf-5dfff8beafc0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:36.991834 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e462c95a-8b52-423f-aabf-5dfff8beafc0 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1731 microversion: 2.20 time: 0.157570 Feb 21 01:41:36.992398 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 461/936] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:36 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:37.160946 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-446e143e-d3d2-400e-bb54-2a4e233d6f8d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:37.161493 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-446e143e-d3d2-400e-bb54-2a4e233d6f8d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:37.168906 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-446e143e-d3d2-400e-bb54-2a4e233d6f8d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:37.169350 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-446e143e-d3d2-400e-bb54-2a4e233d6f8d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:37.170118 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-446e143e-d3d2-400e-bb54-2a4e233d6f8d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:37.170752 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-446e143e-d3d2-400e-bb54-2a4e233d6f8d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:37.198935 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-446e143e-d3d2-400e-bb54-2a4e233d6f8d tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440/os-volume_attachments/de2e173d-aec3-416c-adfe-916366a48b99" status: 200 len: 194 microversion: 2.1 time: 0.042118 Feb 21 01:41:37.199431 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 476/937] 10.222.0.90 () {58 vars in 1412 bytes} [Mon Feb 21 01:41:37 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440/os-volume_attachments/de2e173d-aec3-416c-adfe-916366a48b99 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:41:37.208989 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4cd0a60b-b699-4486-b115-ab05eac7bfac tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:37.209485 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4cd0a60b-b699-4486-b115-ab05eac7bfac tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:37.215367 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cd0a60b-b699-4486-b115-ab05eac7bfac tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:37.215820 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cd0a60b-b699-4486-b115-ab05eac7bfac tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:37.216633 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cd0a60b-b699-4486-b115-ab05eac7bfac tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:37.217070 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4cd0a60b-b699-4486-b115-ab05eac7bfac tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:37.292296 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-4cd0a60b-b699-4486-b115-ab05eac7bfac tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lazy-loading 'services' on Instance uuid 17ebd735-bf6a-4bf3-a66f-e1760c542440 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:41:37.472780 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4cd0a60b-b699-4486-b115-ab05eac7bfac tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "DELETE /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440/os-volume_attachments/de2e173d-aec3-416c-adfe-916366a48b99" status: 202 len: 0 microversion: 2.1 time: 0.267324 Feb 21 01:41:37.473406 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 462/938] 10.222.0.90 () {58 vars in 1415 bytes} [Mon Feb 21 01:41:37 2022] DELETE /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440/os-volume_attachments/de2e173d-aec3-416c-adfe-916366a48b99 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:41:38.011483 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9873643c-ed5d-4639-aaf6-e94b63f4ec98 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:38.012152 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9873643c-ed5d-4639-aaf6-e94b63f4ec98 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:38.018844 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9873643c-ed5d-4639-aaf6-e94b63f4ec98 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:38.024055 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9873643c-ed5d-4639-aaf6-e94b63f4ec98 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:38.024055 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9873643c-ed5d-4639-aaf6-e94b63f4ec98 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:38.024055 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9873643c-ed5d-4639-aaf6-e94b63f4ec98 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:38.158104 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-9873643c-ed5d-4639-aaf6-e94b63f4ec98 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:38.166550 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-9873643c-ed5d-4639-aaf6-e94b63f4ec98 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:38.167668 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-9873643c-ed5d-4639-aaf6-e94b63f4ec98 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:38.168856 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9873643c-ed5d-4639-aaf6-e94b63f4ec98 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1731 microversion: 2.20 time: 0.162070 Feb 21 01:41:38.169429 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 477/939] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:38 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:38.634639 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e1b06055-0b00-4855-9b7d-ce3349a75a70 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:38.635688 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e1b06055-0b00-4855-9b7d-ce3349a75a70 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:38.642090 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1b06055-0b00-4855-9b7d-ce3349a75a70 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:38.642540 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1b06055-0b00-4855-9b7d-ce3349a75a70 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:38.643313 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1b06055-0b00-4855-9b7d-ce3349a75a70 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:38.643742 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1b06055-0b00-4855-9b7d-ce3349a75a70 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:38.671704 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e1b06055-0b00-4855-9b7d-ce3349a75a70 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041730 Feb 21 01:41:38.672268 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 463/940] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:41:38 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 01:41:38.769732 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8671f2c6-18c6-44df-9c03-a75f94e01d53 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:38.770631 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8671f2c6-18c6-44df-9c03-a75f94e01d53 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:38.776814 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8671f2c6-18c6-44df-9c03-a75f94e01d53 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:38.777284 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8671f2c6-18c6-44df-9c03-a75f94e01d53 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:38.778042 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8671f2c6-18c6-44df-9c03-a75f94e01d53 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:38.778468 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8671f2c6-18c6-44df-9c03-a75f94e01d53 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:38.806700 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8671f2c6-18c6-44df-9c03-a75f94e01d53 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040604 Feb 21 01:41:38.808693 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 478/941] 10.222.0.90 () {58 vars in 1301 bytes} [Mon Feb 21 01:41:38 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 21 01:41:38.861919 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9f8e2b9f-74f5-44ac-81c2-b1f7874b16bd tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:38.862423 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9f8e2b9f-74f5-44ac-81c2-b1f7874b16bd tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:38.868851 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f8e2b9f-74f5-44ac-81c2-b1f7874b16bd tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:38.869300 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f8e2b9f-74f5-44ac-81c2-b1f7874b16bd tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:38.870078 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f8e2b9f-74f5-44ac-81c2-b1f7874b16bd tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:38.870563 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9f8e2b9f-74f5-44ac-81c2-b1f7874b16bd tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:38.895377 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9f8e2b9f-74f5-44ac-81c2-b1f7874b16bd tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:41:39.186953 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9f8e2b9f-74f5-44ac-81c2-b1f7874b16bd tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "DELETE /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440" status: 204 len: 0 microversion: 2.1 time: 0.328477 Feb 21 01:41:39.187624 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 464/942] 10.222.0.90 () {58 vars in 1238 bytes} [Mon Feb 21 01:41:38 2022] DELETE /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:41:39.188844 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-48f8c93e-25b6-4aaf-b358-64907fec05c3 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:39.189454 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-48f8c93e-25b6-4aaf-b358-64907fec05c3 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:39.195393 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48f8c93e-25b6-4aaf-b358-64907fec05c3 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:39.195618 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2f9d11e2-bc71-4126-90db-b4e4c04923e1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:39.195837 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48f8c93e-25b6-4aaf-b358-64907fec05c3 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:39.196323 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2f9d11e2-bc71-4126-90db-b4e4c04923e1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:39.196633 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48f8c93e-25b6-4aaf-b358-64907fec05c3 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:39.197293 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-48f8c93e-25b6-4aaf-b358-64907fec05c3 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:39.202311 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f9d11e2-bc71-4126-90db-b4e4c04923e1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:39.203127 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f9d11e2-bc71-4126-90db-b4e4c04923e1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:39.204517 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f9d11e2-bc71-4126-90db-b4e4c04923e1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:39.204969 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2f9d11e2-bc71-4126-90db-b4e4c04923e1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:39.401488 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-48f8c93e-25b6-4aaf-b358-64907fec05c3 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:39.408542 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-2f9d11e2-bc71-4126-90db-b4e4c04923e1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:39.409737 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-48f8c93e-25b6-4aaf-b358-64907fec05c3 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:39.411661 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-48f8c93e-25b6-4aaf-b358-64907fec05c3 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:39.413399 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-48f8c93e-25b6-4aaf-b358-64907fec05c3 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1731 microversion: 2.20 time: 0.228515 Feb 21 01:41:39.414087 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 479/943] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:39 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1731 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:41:39.416766 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2f9d11e2-bc71-4126-90db-b4e4c04923e1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440" status: 200 len: 1674 microversion: 2.1 time: 0.224630 Feb 21 01:41:39.417487 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 465/944] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:39 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440 => generated 1674 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:41:39.476796 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-8cfa93e3-2162-45d7-bbfe-f4f4aff8f1d4 req-62d6ed3e-1532-4042-a036-9928b71076e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e49ba09-7813-4190-b34c-c2a6fc9c49bb", "name": "network-vif-plugged", "status": "completed", "tag": "f62f5ef9-41f3-4a8a-abf2-f89200d260f6"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:41:39.478239 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:41:39.478239 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:41:39.485109 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-8cfa93e3-2162-45d7-bbfe-f4f4aff8f1d4 req-62d6ed3e-1532-4042-a036-9928b71076e8 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:39.485547 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-8cfa93e3-2162-45d7-bbfe-f4f4aff8f1d4 req-62d6ed3e-1532-4042-a036-9928b71076e8 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:39.495940 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-8cfa93e3-2162-45d7-bbfe-f4f4aff8f1d4 req-62d6ed3e-1532-4042-a036-9928b71076e8 service nova] Creating event network-vif-plugged:f62f5ef9-41f3-4a8a-abf2-f89200d260f6 for instance 6e49ba09-7813-4190-b34c-c2a6fc9c49bb on hv-cinder-81322 Feb 21 01:41:39.501104 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-8cfa93e3-2162-45d7-bbfe-f4f4aff8f1d4 req-62d6ed3e-1532-4042-a036-9928b71076e8 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027823 Feb 21 01:41:39.506500 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 480/945] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:41:40.431690 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-41d6e172-29a4-44b8-b691-c5c39f9718f9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:40.432300 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-41d6e172-29a4-44b8-b691-c5c39f9718f9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:40.435341 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1545bef9-5646-4e82-ab0c-49abb8d5501e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:40.436071 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1545bef9-5646-4e82-ab0c-49abb8d5501e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:40.438982 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-41d6e172-29a4-44b8-b691-c5c39f9718f9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:40.439408 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-41d6e172-29a4-44b8-b691-c5c39f9718f9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:40.440189 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-41d6e172-29a4-44b8-b691-c5c39f9718f9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:40.440643 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-41d6e172-29a4-44b8-b691-c5c39f9718f9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:40.442411 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1545bef9-5646-4e82-ab0c-49abb8d5501e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:40.442864 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1545bef9-5646-4e82-ab0c-49abb8d5501e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:40.443647 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1545bef9-5646-4e82-ab0c-49abb8d5501e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:40.444139 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1545bef9-5646-4e82-ab0c-49abb8d5501e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:40.637732 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-41d6e172-29a4-44b8-b691-c5c39f9718f9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:40.644638 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1545bef9-5646-4e82-ab0c-49abb8d5501e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:40.645622 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-41d6e172-29a4-44b8-b691-c5c39f9718f9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:40.647133 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-41d6e172-29a4-44b8-b691-c5c39f9718f9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:40.648272 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-41d6e172-29a4-44b8-b691-c5c39f9718f9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1731 microversion: 2.20 time: 0.220932 Feb 21 01:41:40.648894 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 466/946] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:40 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1731 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:40.651828 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1545bef9-5646-4e82-ab0c-49abb8d5501e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440" status: 200 len: 1674 microversion: 2.1 time: 0.221625 Feb 21 01:41:40.652383 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 481/947] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:40 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440 => generated 1674 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:41:41.666093 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9107cc7b-bc14-406f-80fc-3ff36fc749f1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:41.666708 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9107cc7b-bc14-406f-80fc-3ff36fc749f1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:41.669698 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5ea00a58-c871-491a-9e5f-8e47b72d62f6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:41.670315 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5ea00a58-c871-491a-9e5f-8e47b72d62f6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:41.673282 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9107cc7b-bc14-406f-80fc-3ff36fc749f1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:41.673937 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9107cc7b-bc14-406f-80fc-3ff36fc749f1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:41.674786 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9107cc7b-bc14-406f-80fc-3ff36fc749f1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:41.675144 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9107cc7b-bc14-406f-80fc-3ff36fc749f1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:41.681507 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ea00a58-c871-491a-9e5f-8e47b72d62f6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:41.681965 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ea00a58-c871-491a-9e5f-8e47b72d62f6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:41.682879 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ea00a58-c871-491a-9e5f-8e47b72d62f6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:41.683317 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ea00a58-c871-491a-9e5f-8e47b72d62f6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:41.970356 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-9107cc7b-bc14-406f-80fc-3ff36fc749f1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:41.974190 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-5ea00a58-c871-491a-9e5f-8e47b72d62f6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:41.979962 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-9107cc7b-bc14-406f-80fc-3ff36fc749f1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:41.981538 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-9107cc7b-bc14-406f-80fc-3ff36fc749f1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:41.982713 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9107cc7b-bc14-406f-80fc-3ff36fc749f1 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1731 microversion: 2.20 time: 0.321153 Feb 21 01:41:41.982863 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5ea00a58-c871-491a-9e5f-8e47b72d62f6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440" status: 200 len: 1674 microversion: 2.1 time: 0.317899 Feb 21 01:41:41.983702 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 482/948] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:41 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440 => generated 1674 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:41.993311 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 467/949] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:41 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1731 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 21 01:41:42.678795 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-02d16f4a-a3ed-45c5-b1a3-b44a1dff0577 req-1f9bdc17-edf7-4b2b-aebb-a5b8db10ced1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ebd735-bf6a-4bf3-a66f-e1760c542440", "name": "network-vif-deleted", "tag": "1586cbad-a660-482d-a053-cbacd581a4bd"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:41:42.680393 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:41:42.680393 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:41:42.687373 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-02d16f4a-a3ed-45c5-b1a3-b44a1dff0577 req-1f9bdc17-edf7-4b2b-aebb-a5b8db10ced1 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:42.687820 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-02d16f4a-a3ed-45c5-b1a3-b44a1dff0577 req-1f9bdc17-edf7-4b2b-aebb-a5b8db10ced1 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:42.699102 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-02d16f4a-a3ed-45c5-b1a3-b44a1dff0577 req-1f9bdc17-edf7-4b2b-aebb-a5b8db10ced1 service nova] Creating event network-vif-deleted:1586cbad-a660-482d-a053-cbacd581a4bd for instance 17ebd735-bf6a-4bf3-a66f-e1760c542440 on hv-cinder-81322 Feb 21 01:41:42.704282 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-02d16f4a-a3ed-45c5-b1a3-b44a1dff0577 req-1f9bdc17-edf7-4b2b-aebb-a5b8db10ced1 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029021 Feb 21 01:41:42.705156 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 483/950] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:41:43.001153 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ef2ceada-88bd-411a-beaa-7320d193389f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:43.001642 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a0f25433-5438-492a-ae2d-b80551c25a57 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:43.002090 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a0f25433-5438-492a-ae2d-b80551c25a57 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:43.002214 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ef2ceada-88bd-411a-beaa-7320d193389f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:43.008906 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef2ceada-88bd-411a-beaa-7320d193389f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:43.009069 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a0f25433-5438-492a-ae2d-b80551c25a57 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:43.009424 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a0f25433-5438-492a-ae2d-b80551c25a57 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:43.009670 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef2ceada-88bd-411a-beaa-7320d193389f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:43.010213 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a0f25433-5438-492a-ae2d-b80551c25a57 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:43.010650 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a0f25433-5438-492a-ae2d-b80551c25a57 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:43.011032 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef2ceada-88bd-411a-beaa-7320d193389f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:43.011659 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef2ceada-88bd-411a-beaa-7320d193389f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:43.044256 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef2ceada-88bd-411a-beaa-7320d193389f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:43.044910 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ef2ceada-88bd-411a-beaa-7320d193389f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:43.045460 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-ef2ceada-88bd-411a-beaa-7320d193389f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lazy-loading 'fault' on Instance uuid 17ebd735-bf6a-4bf3-a66f-e1760c542440 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:41:43.104054 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ef2ceada-88bd-411a-beaa-7320d193389f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d834a0b1ec1481eaf1387dd4e302cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bc5c58fd414c8aa76756065678191e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:43.111845 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ef2ceada-88bd-411a-beaa-7320d193389f tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440" status: 200 len: 1327 microversion: 2.1 time: 0.114890 Feb 21 01:41:43.112827 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 468/951] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:42 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440 => generated 1327 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:43.189092 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-a0f25433-5438-492a-ae2d-b80551c25a57 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:43.198042 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-a0f25433-5438-492a-ae2d-b80551c25a57 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:43.207458 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-a0f25433-5438-492a-ae2d-b80551c25a57 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:43.208715 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a0f25433-5438-492a-ae2d-b80551c25a57 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1718 microversion: 2.20 time: 0.211553 Feb 21 01:41:43.209292 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 484/952] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:41:42 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1718 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:41:44.129069 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-52ec925c-5aaa-474c-b044-ccdb68eae7c6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:44.129686 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-52ec925c-5aaa-474c-b044-ccdb68eae7c6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:44.136269 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52ec925c-5aaa-474c-b044-ccdb68eae7c6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:44.136758 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52ec925c-5aaa-474c-b044-ccdb68eae7c6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:44.137534 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52ec925c-5aaa-474c-b044-ccdb68eae7c6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:44.137965 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52ec925c-5aaa-474c-b044-ccdb68eae7c6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:44.151674 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-52ec925c-5aaa-474c-b044-ccdb68eae7c6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] HTTP exception thrown: Instance 17ebd735-bf6a-4bf3-a66f-e1760c542440 could not be found. Feb 21 01:41:44.152276 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-52ec925c-5aaa-474c-b044-ccdb68eae7c6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Returning 404 to user: Instance 17ebd735-bf6a-4bf3-a66f-e1760c542440 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:41:44.153157 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-52ec925c-5aaa-474c-b044-ccdb68eae7c6 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440" status: 404 len: 111 microversion: 2.1 time: 0.027813 Feb 21 01:41:44.153717 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 469/953] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:44 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:41:44.161935 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2b9b1d7b-f783-4031-9343-59e17195604e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '.version_select at 0x7f4075bb03a0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:44.165937 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2b9b1d7b-f783-4031-9343-59e17195604e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [a0436488-2d81-40c8-bff9-bf11e082ac2c] AMQP server on 10.222.0.90:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 21 01:41:44.456800 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e7df823d-7b79-4f08-a246-842e00a57e52 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:44.457511 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e7df823d-7b79-4f08-a246-842e00a57e52 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:44.463955 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7df823d-7b79-4f08-a246-842e00a57e52 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:44.464417 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7df823d-7b79-4f08-a246-842e00a57e52 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:44.465220 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7df823d-7b79-4f08-a246-842e00a57e52 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:44.465649 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e7df823d-7b79-4f08-a246-842e00a57e52 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:44.490591 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e7df823d-7b79-4f08-a246-842e00a57e52 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:41:44.811211 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e7df823d-7b79-4f08-a246-842e00a57e52 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "DELETE /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 204 len: 0 microversion: 2.1 time: 0.357900 Feb 21 01:41:44.811927 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 470/954] 10.222.0.90 () {58 vars in 1238 bytes} [Mon Feb 21 01:41:44 2022] DELETE /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:41:44.817265 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-b6dfcf39-efb7-4529-b579-f4afebef8f18 req-bfd4f8c2-9337-4edb-90fd-bc630281c2b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bfdab9d-ba0f-4923-ad4e-40ef23db9338", "tag": "682a620b-646c-4dfa-8198-bae01e8d1e36"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:41:44.818796 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:41:44.818796 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:41:44.826087 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b6dfcf39-efb7-4529-b579-f4afebef8f18 req-bfd4f8c2-9337-4edb-90fd-bc630281c2b3 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:44.826528 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-b6dfcf39-efb7-4529-b579-f4afebef8f18 req-bfd4f8c2-9337-4edb-90fd-bc630281c2b3 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:44.838856 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-b6dfcf39-efb7-4529-b579-f4afebef8f18 req-bfd4f8c2-9337-4edb-90fd-bc630281c2b3 service nova] Creating event network-changed:682a620b-646c-4dfa-8198-bae01e8d1e36 for instance 3bfdab9d-ba0f-4923-ad4e-40ef23db9338 on hv-cinder-81322 Feb 21 01:41:44.843843 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-b6dfcf39-efb7-4529-b579-f4afebef8f18 req-bfd4f8c2-9337-4edb-90fd-bc630281c2b3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030398 Feb 21 01:41:44.844714 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 471/955] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:41:44.849512 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-98998106-f1c8-4d7d-a8e8-c5f74f03e29b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:44.850201 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-98998106-f1c8-4d7d-a8e8-c5f74f03e29b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:44.856905 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98998106-f1c8-4d7d-a8e8-c5f74f03e29b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:44.857537 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98998106-f1c8-4d7d-a8e8-c5f74f03e29b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:44.858126 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98998106-f1c8-4d7d-a8e8-c5f74f03e29b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:44.858558 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-98998106-f1c8-4d7d-a8e8-c5f74f03e29b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:44.991775 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-98998106-f1c8-4d7d-a8e8-c5f74f03e29b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:44.999668 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-98998106-f1c8-4d7d-a8e8-c5f74f03e29b tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1568 microversion: 2.1 time: 0.153800 Feb 21 01:41:45.000170 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 472/956] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:44 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:45.173069 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [None req-2b9b1d7b-f783-4031-9343-59e17195604e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [a0436488-2d81-40c8-bff9-bf11e082ac2c] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 59340. Feb 21 01:41:45.242564 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2b9b1d7b-f783-4031-9343-59e17195604e tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1685777227" status: 202 len: 0 microversion: 2.1 time: 1.084143 Feb 21 01:41:45.243151 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 485/957] 10.222.0.90 () {58 vars in 1220 bytes} [Mon Feb 21 01:41:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1685777227 => generated 0 bytes in 1085 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 21 01:41:46.019989 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1a21da43-3597-404f-ae20-3c8a39cc3b8a tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:46.020664 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1a21da43-3597-404f-ae20-3c8a39cc3b8a tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:46.027379 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a21da43-3597-404f-ae20-3c8a39cc3b8a tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:46.027832 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a21da43-3597-404f-ae20-3c8a39cc3b8a tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:46.028647 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a21da43-3597-404f-ae20-3c8a39cc3b8a tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:46.029094 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1a21da43-3597-404f-ae20-3c8a39cc3b8a tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:46.215068 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-1a21da43-3597-404f-ae20-3c8a39cc3b8a tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:46.223172 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1a21da43-3597-404f-ae20-3c8a39cc3b8a tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1450 microversion: 2.1 time: 0.208243 Feb 21 01:41:46.223868 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 473/958] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:46 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1450 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:47.240297 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-f6916b60-40f9-4131-a44a-b7989c8dbd76 req-e9a82c4c-b754-4101-a9d9-5b7b374469ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bfdab9d-ba0f-4923-ad4e-40ef23db9338", "name": "network-vif-deleted", "tag": "682a620b-646c-4dfa-8198-bae01e8d1e36"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:41:47.241051 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2788018f-6b1c-4115-ab78-ed07f517115f tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:47.241457 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2788018f-6b1c-4115-ab78-ed07f517115f tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:47.242447 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:41:47.242447 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:41:47.248529 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2788018f-6b1c-4115-ab78-ed07f517115f tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:47.249219 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2788018f-6b1c-4115-ab78-ed07f517115f tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:47.250018 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2788018f-6b1c-4115-ab78-ed07f517115f tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:47.250455 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2788018f-6b1c-4115-ab78-ed07f517115f tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:47.250918 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f6916b60-40f9-4131-a44a-b7989c8dbd76 req-e9a82c4c-b754-4101-a9d9-5b7b374469ea service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:47.251621 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f6916b60-40f9-4131-a44a-b7989c8dbd76 req-e9a82c4c-b754-4101-a9d9-5b7b374469ea service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:47.267852 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-f6916b60-40f9-4131-a44a-b7989c8dbd76 req-e9a82c4c-b754-4101-a9d9-5b7b374469ea service nova] Creating event network-vif-deleted:682a620b-646c-4dfa-8198-bae01e8d1e36 for instance 3bfdab9d-ba0f-4923-ad4e-40ef23db9338 on hv-cinder-81322 Feb 21 01:41:47.273473 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-f6916b60-40f9-4131-a44a-b7989c8dbd76 req-e9a82c4c-b754-4101-a9d9-5b7b374469ea service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036563 Feb 21 01:41:47.274450 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 486/959] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:41:47.318270 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-2788018f-6b1c-4115-ab78-ed07f517115f tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:47.326423 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2788018f-6b1c-4115-ab78-ed07f517115f tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1383 microversion: 2.1 time: 0.089779 Feb 21 01:41:47.327053 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 474/960] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:47 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1383 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:48.344618 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f509faa0-5d03-4c25-8a84-bd29f6fdf6c7 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:48.345317 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f509faa0-5d03-4c25-8a84-bd29f6fdf6c7 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:48.351700 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f509faa0-5d03-4c25-8a84-bd29f6fdf6c7 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:48.352151 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f509faa0-5d03-4c25-8a84-bd29f6fdf6c7 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:48.352976 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f509faa0-5d03-4c25-8a84-bd29f6fdf6c7 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:48.353409 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f509faa0-5d03-4c25-8a84-bd29f6fdf6c7 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:48.386613 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f509faa0-5d03-4c25-8a84-bd29f6fdf6c7 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:48.387066 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f509faa0-5d03-4c25-8a84-bd29f6fdf6c7 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:48.387511 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-f509faa0-5d03-4c25-8a84-bd29f6fdf6c7 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lazy-loading 'fault' on Instance uuid 3bfdab9d-ba0f-4923-ad4e-40ef23db9338 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:41:48.426475 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-f509faa0-5d03-4c25-8a84-bd29f6fdf6c7 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07356563a079427b97e47ce2a11b54b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '360e1042eb3f47f5be6a603e1877d9d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:41:48.433769 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f509faa0-5d03-4c25-8a84-bd29f6fdf6c7 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 200 len: 1225 microversion: 2.1 time: 0.093328 Feb 21 01:41:48.434335 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 487/961] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:48 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:41:48.755351 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cd4cee8b-4a9a-412a-b461-1030b8765b95 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:48.755833 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cd4cee8b-4a9a-412a-b461-1030b8765b95 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:48.763548 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd4cee8b-4a9a-412a-b461-1030b8765b95 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:48.764004 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd4cee8b-4a9a-412a-b461-1030b8765b95 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:48.764829 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd4cee8b-4a9a-412a-b461-1030b8765b95 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:48.765267 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cd4cee8b-4a9a-412a-b461-1030b8765b95 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:48.778841 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-cd4cee8b-4a9a-412a-b461-1030b8765b95 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] HTTP exception thrown: Instance 17ebd735-bf6a-4bf3-a66f-e1760c542440 could not be found. Feb 21 01:41:48.779367 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cd4cee8b-4a9a-412a-b461-1030b8765b95 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Returning 404 to user: Instance 17ebd735-bf6a-4bf3-a66f-e1760c542440 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:41:48.780232 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cd4cee8b-4a9a-412a-b461-1030b8765b95 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "DELETE /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440" status: 404 len: 111 microversion: 2.1 time: 0.028555 Feb 21 01:41:48.780795 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 475/962] 10.222.0.90 () {58 vars in 1238 bytes} [Mon Feb 21 01:41:48 2022] DELETE /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:41:48.788390 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0cef6794-f507-4c08-9bfa-64de99ccc5b7 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:48.789018 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0cef6794-f507-4c08-9bfa-64de99ccc5b7 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: 17ebd735-bf6a-4bf3-a66f-e1760c542440] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:48.795303 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0cef6794-f507-4c08-9bfa-64de99ccc5b7 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:48.795744 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0cef6794-f507-4c08-9bfa-64de99ccc5b7 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:48.796567 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0cef6794-f507-4c08-9bfa-64de99ccc5b7 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:48.796996 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0cef6794-f507-4c08-9bfa-64de99ccc5b7 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:48.809854 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-0cef6794-f507-4c08-9bfa-64de99ccc5b7 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] HTTP exception thrown: Instance 17ebd735-bf6a-4bf3-a66f-e1760c542440 could not be found. Feb 21 01:41:48.810422 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0cef6794-f507-4c08-9bfa-64de99ccc5b7 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Returning 404 to user: Instance 17ebd735-bf6a-4bf3-a66f-e1760c542440 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:41:48.811210 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0cef6794-f507-4c08-9bfa-64de99ccc5b7 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440" status: 404 len: 111 microversion: 2.1 time: 0.026481 Feb 21 01:41:48.811717 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 488/963] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:48 2022] GET /compute/v2.1/servers/17ebd735-bf6a-4bf3-a66f-e1760c542440 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:41:49.454973 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-02a7d5d0-a190-4291-bd81-234be417b338 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:49.455572 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-02a7d5d0-a190-4291-bd81-234be417b338 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] [instance: 3bfdab9d-ba0f-4923-ad4e-40ef23db9338] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:49.461377 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02a7d5d0-a190-4291-bd81-234be417b338 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:49.462333 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02a7d5d0-a190-4291-bd81-234be417b338 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:49.463097 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02a7d5d0-a190-4291-bd81-234be417b338 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:49.463530 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-02a7d5d0-a190-4291-bd81-234be417b338 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:49.476507 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-02a7d5d0-a190-4291-bd81-234be417b338 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] HTTP exception thrown: Instance 3bfdab9d-ba0f-4923-ad4e-40ef23db9338 could not be found. Feb 21 01:41:49.477101 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-02a7d5d0-a190-4291-bd81-234be417b338 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Returning 404 to user: Instance 3bfdab9d-ba0f-4923-ad4e-40ef23db9338 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:41:49.478588 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-02a7d5d0-a190-4291-bd81-234be417b338 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338" status: 404 len: 111 microversion: 2.1 time: 0.027442 Feb 21 01:41:49.479105 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 476/964] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:49 2022] GET /compute/v2.1/servers/3bfdab9d-ba0f-4923-ad4e-40ef23db9338 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:41:49.713233 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-eed08152-503e-4ad2-b11d-64093d481ca8 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] Calling method '.version_select at 0x7f4075bb0940>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:49.783378 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-eed08152-503e-4ad2-b11d-64093d481ca8 tempest-TestShelveInstance-1565548751 tempest-TestShelveInstance-1565548751-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1144935184" status: 202 len: 0 microversion: 2.1 time: 0.074446 Feb 21 01:41:49.783984 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 489/965] 10.222.0.90 () {58 vars in 1253 bytes} [Mon Feb 21 01:41:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1144935184 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:41:50.036118 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8719e9e0-f79c-4746-b3a4-5126eab7dbd1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:50.036677 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-8719e9e0-f79c-4746-b3a4-5126eab7dbd1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:50.043257 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8719e9e0-f79c-4746-b3a4-5126eab7dbd1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:50.043716 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8719e9e0-f79c-4746-b3a4-5126eab7dbd1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:50.044533 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8719e9e0-f79c-4746-b3a4-5126eab7dbd1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:50.044974 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-8719e9e0-f79c-4746-b3a4-5126eab7dbd1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:50.058139 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-8719e9e0-f79c-4746-b3a4-5126eab7dbd1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] HTTP exception thrown: Instance ff526a32-96c9-4481-a88c-a0913652acfd could not be found. Feb 21 01:41:50.058722 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-8719e9e0-f79c-4746-b3a4-5126eab7dbd1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Returning 404 to user: Instance ff526a32-96c9-4481-a88c-a0913652acfd could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:41:50.059549 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-8719e9e0-f79c-4746-b3a4-5126eab7dbd1 tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 404 len: 111 microversion: 2.1 time: 0.027512 Feb 21 01:41:50.060101 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 477/966] 10.222.0.90 () {58 vars in 1238 bytes} [Mon Feb 21 01:41:50 2022] DELETE /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:41:50.067921 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1b42d800-1743-4aa4-a752-ab20c2a323bd tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:41:50.068568 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1b42d800-1743-4aa4-a752-ab20c2a323bd tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] [instance: ff526a32-96c9-4481-a88c-a0913652acfd] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:41:50.074820 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b42d800-1743-4aa4-a752-ab20c2a323bd tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:50.075275 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b42d800-1743-4aa4-a752-ab20c2a323bd tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:50.076080 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b42d800-1743-4aa4-a752-ab20c2a323bd tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:41:50.076542 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1b42d800-1743-4aa4-a752-ab20c2a323bd tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:41:50.090059 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-1b42d800-1743-4aa4-a752-ab20c2a323bd tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] HTTP exception thrown: Instance ff526a32-96c9-4481-a88c-a0913652acfd could not be found. Feb 21 01:41:50.090645 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1b42d800-1743-4aa4-a752-ab20c2a323bd tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] Returning 404 to user: Instance ff526a32-96c9-4481-a88c-a0913652acfd could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:41:50.091451 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1b42d800-1743-4aa4-a752-ab20c2a323bd tempest-AttachVolumeTestJSON-834813537 tempest-AttachVolumeTestJSON-834813537-project] 10.222.0.90 "GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd" status: 404 len: 111 microversion: 2.1 time: 0.027195 Feb 21 01:41:50.091979 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 490/967] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:41:50 2022] GET /compute/v2.1/servers/ff526a32-96c9-4481-a88c-a0913652acfd => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:42:03.595642 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:42:03.595642 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: Mon Feb 21 01:42:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:42:12.971970 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4aa552ab-fcda-4b0e-8af4-23e5df9d71bf tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Action: 'create', calling method: .version_select at 0x7f4075d16160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1828841158"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:42:12.985494 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-4aa552ab-fcda-4b0e-8af4-23e5df9d71bf tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Getting quotas for project 94593ad3d3934da1ab80ce0c851c7d3e. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:42:12.989400 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-4aa552ab-fcda-4b0e-8af4-23e5df9d71bf tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Getting quotas for user fa4b889b3aff47cea0a0d254870515cd and project 94593ad3d3934da1ab80ce0c851c7d3e. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:42:13.001323 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4aa552ab-fcda-4b0e-8af4-23e5df9d71bf tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [3c809fc5-25f0-4007-8c09-863adffe9bdc] AMQP server on 10.222.0.90:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 21 01:42:14.010364 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [None req-4aa552ab-fcda-4b0e-8af4-23e5df9d71bf tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [3c809fc5-25f0-4007-8c09-863adffe9bdc] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 59758. Feb 21 01:42:14.421859 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-4aa552ab-fcda-4b0e-8af4-23e5df9d71bf tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Getting quotas for project 94593ad3d3934da1ab80ce0c851c7d3e. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:42:14.428960 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-4aa552ab-fcda-4b0e-8af4-23e5df9d71bf tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Getting quotas for user fa4b889b3aff47cea0a0d254870515cd and project 94593ad3d3934da1ab80ce0c851c7d3e. Resources: {'key_pairs'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:42:14.442896 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4aa552ab-fcda-4b0e-8af4-23e5df9d71bf tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 1.640484 Feb 21 01:42:14.443586 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 478/968] 10.222.0.90 () {60 vars in 1157 bytes} [Mon Feb 21 01:42:12 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:41.172820 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-87fe8871-5207-42f4-91af-79d0c6878220 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1943696992", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1828841158", "security_groups": [{"name": "tempest-secgroup-smoke-1551254502"}], "block_device_mapping_v2": [{"uuid": "f6e56dda-4752-4041-afda-44fb26b00128", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "05842dab-dc3d-4a7b-83c4-206a5c07022d"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:42:41.441607 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-87fe8871-5207-42f4-91af-79d0c6878220 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] validate_networks() for [('05842dab-dc3d-4a7b-83c4-206a5c07022d', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:42:41.892549 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-87fe8871-5207-42f4-91af-79d0c6878220 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:42:41.892972 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-87fe8871-5207-42f4-91af-79d0c6878220 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:42:41.893437 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-87fe8871-5207-42f4-91af-79d0c6878220 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:42:41.893837 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-87fe8871-5207-42f4-91af-79d0c6878220 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:42:41.894240 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-87fe8871-5207-42f4-91af-79d0c6878220 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:42:41.903220 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87fe8871-5207-42f4-91af-79d0c6878220 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:41.903665 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87fe8871-5207-42f4-91af-79d0c6878220 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:41.904492 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87fe8871-5207-42f4-91af-79d0c6878220 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:41.904928 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-87fe8871-5207-42f4-91af-79d0c6878220 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:41.921045 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-87fe8871-5207-42f4-91af-79d0c6878220 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Getting quotas for project 94593ad3d3934da1ab80ce0c851c7d3e. Resources: {'ram', 'cores', 'instances'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:42:41.925129 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-87fe8871-5207-42f4-91af-79d0c6878220 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Getting quotas for user fa4b889b3aff47cea0a0d254870515cd and project 94593ad3d3934da1ab80ce0c851c7d3e. Resources: {'ram', 'cores', 'instances'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:42:41.980194 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-87fe8871-5207-42f4-91af-79d0c6878220 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:42:41.982443 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-87fe8871-5207-42f4-91af-79d0c6878220 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f6e56dda-4752-4041-afda-44fb26b00128',volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:42:42.377952 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-87fe8871-5207-42f4-91af-79d0c6878220 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.208830 Feb 21 01:42:42.379275 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 491/969] 10.222.0.90 () {60 vars in 1146 bytes} [Mon Feb 21 01:42:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:42:42.390172 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fad2aefc-6a33-4eba-88b2-79efb38c8a68 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:42.390948 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fad2aefc-6a33-4eba-88b2-79efb38c8a68 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:42.682987 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-fad2aefc-6a33-4eba-88b2-79efb38c8a68 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:42.689794 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fad2aefc-6a33-4eba-88b2-79efb38c8a68 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18" status: 200 len: 1095 microversion: 2.1 time: 0.304673 Feb 21 01:42:42.690457 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 479/970] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:42 2022] GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18 => generated 1095 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:42:43.707017 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8d560e50-2e5a-4b66-9ca5-09b4b571ce3b tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:43.707629 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8d560e50-2e5a-4b66-9ca5-09b4b571ce3b tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:43.714309 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d560e50-2e5a-4b66-9ca5-09b4b571ce3b tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:43.717717 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d560e50-2e5a-4b66-9ca5-09b4b571ce3b tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:43.717717 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d560e50-2e5a-4b66-9ca5-09b4b571ce3b tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:43.717717 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d560e50-2e5a-4b66-9ca5-09b4b571ce3b tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:43.775492 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-8d560e50-2e5a-4b66-9ca5-09b4b571ce3b tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:43.782849 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8d560e50-2e5a-4b66-9ca5-09b4b571ce3b tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18" status: 200 len: 1145 microversion: 2.1 time: 0.079908 Feb 21 01:42:43.783808 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 492/971] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:43 2022] GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:44.798769 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4be65fad-c55a-4cc9-a1ec-e58da6b36dab tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:44.799323 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4be65fad-c55a-4cc9-a1ec-e58da6b36dab tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:44.805430 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4be65fad-c55a-4cc9-a1ec-e58da6b36dab tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:44.805869 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4be65fad-c55a-4cc9-a1ec-e58da6b36dab tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:44.806767 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4be65fad-c55a-4cc9-a1ec-e58da6b36dab tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:44.807095 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4be65fad-c55a-4cc9-a1ec-e58da6b36dab tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:44.923547 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-4be65fad-c55a-4cc9-a1ec-e58da6b36dab tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:44.931689 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4be65fad-c55a-4cc9-a1ec-e58da6b36dab tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18" status: 200 len: 1211 microversion: 2.1 time: 0.136555 Feb 21 01:42:44.941811 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 480/972] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:44 2022] GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18 => generated 1211 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:45.948557 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-24aa020c-699c-4238-8a25-2fa868535560 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:45.949172 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-24aa020c-699c-4238-8a25-2fa868535560 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:45.955291 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-24aa020c-699c-4238-8a25-2fa868535560 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:45.955731 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-24aa020c-699c-4238-8a25-2fa868535560 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:45.956522 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-24aa020c-699c-4238-8a25-2fa868535560 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:45.956951 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-24aa020c-699c-4238-8a25-2fa868535560 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:46.224931 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-24aa020c-699c-4238-8a25-2fa868535560 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:46.232984 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-24aa020c-699c-4238-8a25-2fa868535560 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18" status: 200 len: 1267 microversion: 2.1 time: 0.287977 Feb 21 01:42:46.233777 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 493/973] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:45 2022] GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18 => generated 1267 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:46.912567 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-6152805a-6e5b-46b1-a391-2edbce74c5d2 req-33cda30a-8291-4b03-8d7c-d62444b1ce89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28ebc3bf-d635-4c37-869a-261c9ec07c18", "tag": "75fcf9e4-d75d-42b6-a1f3-4f77b840ca06"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:42:46.914192 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:42:46.914192 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:42:46.921519 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6152805a-6e5b-46b1-a391-2edbce74c5d2 req-33cda30a-8291-4b03-8d7c-d62444b1ce89 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:46.922203 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-6152805a-6e5b-46b1-a391-2edbce74c5d2 req-33cda30a-8291-4b03-8d7c-d62444b1ce89 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:46.934328 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-6152805a-6e5b-46b1-a391-2edbce74c5d2 req-33cda30a-8291-4b03-8d7c-d62444b1ce89 service nova] Creating event network-changed:75fcf9e4-d75d-42b6-a1f3-4f77b840ca06 for instance 28ebc3bf-d635-4c37-869a-261c9ec07c18 on hv-cinder-81322 Feb 21 01:42:46.939751 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-6152805a-6e5b-46b1-a391-2edbce74c5d2 req-33cda30a-8291-4b03-8d7c-d62444b1ce89 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163961 Feb 21 01:42:46.940759 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 481/974] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:42:47.250740 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1a37ea82-b57c-4d4c-b0dc-9ec1ab6dffc8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:47.251341 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1a37ea82-b57c-4d4c-b0dc-9ec1ab6dffc8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:47.260584 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a37ea82-b57c-4d4c-b0dc-9ec1ab6dffc8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:47.260584 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a37ea82-b57c-4d4c-b0dc-9ec1ab6dffc8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:47.260584 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a37ea82-b57c-4d4c-b0dc-9ec1ab6dffc8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:47.260584 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1a37ea82-b57c-4d4c-b0dc-9ec1ab6dffc8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:47.277923 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e18f0171-2edf-4ab8-99b7-f15a2367ab4a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:47.278923 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e18f0171-2edf-4ab8-99b7-f15a2367ab4a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:47.284969 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e18f0171-2edf-4ab8-99b7-f15a2367ab4a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:47.285423 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e18f0171-2edf-4ab8-99b7-f15a2367ab4a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:47.286205 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e18f0171-2edf-4ab8-99b7-f15a2367ab4a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:47.286638 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e18f0171-2edf-4ab8-99b7-f15a2367ab4a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:47.318431 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e18f0171-2edf-4ab8-99b7-f15a2367ab4a tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044599 Feb 21 01:42:47.319007 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 482/975] 10.222.0.90 () {60 vars in 1342 bytes} [Mon Feb 21 01:42:47 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:42:47.375534 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-57d4dd8f-eca6-4434-89dd-5c3d421485ab tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:47.376107 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-57d4dd8f-eca6-4434-89dd-5c3d421485ab tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:47.382220 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57d4dd8f-eca6-4434-89dd-5c3d421485ab tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:47.382675 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57d4dd8f-eca6-4434-89dd-5c3d421485ab tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:47.383573 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57d4dd8f-eca6-4434-89dd-5c3d421485ab tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:47.384017 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-57d4dd8f-eca6-4434-89dd-5c3d421485ab tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:47.403165 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1a37ea82-b57c-4d4c-b0dc-9ec1ab6dffc8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:47.411758 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1a37ea82-b57c-4d4c-b0dc-9ec1ab6dffc8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18" status: 200 len: 1267 microversion: 2.1 time: 0.164521 Feb 21 01:42:47.419611 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-57d4dd8f-eca6-4434-89dd-5c3d421485ab tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:42:47.421880 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 494/976] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:47 2022] GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:47.721524 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-57d4dd8f-eca6-4434-89dd-5c3d421485ab tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "DELETE /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 204 len: 0 microversion: 2.20 time: 0.348933 Feb 21 01:42:47.722333 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 483/977] 10.222.0.90 () {60 vars in 1279 bytes} [Mon Feb 21 01:42:47 2022] DELETE /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 21 01:42:47.730263 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-67e68214-d449-4f1d-a54c-fe8fb9d7801b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:47.730877 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-67e68214-d449-4f1d-a54c-fe8fb9d7801b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:47.740824 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-67e68214-d449-4f1d-a54c-fe8fb9d7801b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:47.740824 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-67e68214-d449-4f1d-a54c-fe8fb9d7801b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:47.740824 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-67e68214-d449-4f1d-a54c-fe8fb9d7801b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:47.740824 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-67e68214-d449-4f1d-a54c-fe8fb9d7801b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:47.950578 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-67e68214-d449-4f1d-a54c-fe8fb9d7801b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:47.958730 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-67e68214-d449-4f1d-a54c-fe8fb9d7801b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:47.960450 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-67e68214-d449-4f1d-a54c-fe8fb9d7801b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:47.961956 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-67e68214-d449-4f1d-a54c-fe8fb9d7801b tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1724 microversion: 2.20 time: 0.235071 Feb 21 01:42:47.962484 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 495/978] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:42:47 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:42:48.428799 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d8320ecc-dcbb-4e72-8807-bcd6f38df0d0 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:48.429510 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d8320ecc-dcbb-4e72-8807-bcd6f38df0d0 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:48.438826 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8320ecc-dcbb-4e72-8807-bcd6f38df0d0 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:48.439296 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8320ecc-dcbb-4e72-8807-bcd6f38df0d0 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:48.440081 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8320ecc-dcbb-4e72-8807-bcd6f38df0d0 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:48.440541 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d8320ecc-dcbb-4e72-8807-bcd6f38df0d0 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:48.579258 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-d8320ecc-dcbb-4e72-8807-bcd6f38df0d0 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:48.586377 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d8320ecc-dcbb-4e72-8807-bcd6f38df0d0 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18" status: 200 len: 1267 microversion: 2.1 time: 0.161712 Feb 21 01:42:48.586940 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 484/979] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:48 2022] GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:48.981023 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7312d8e5-31ce-4b10-8fd3-e1142a71dd71 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:48.981656 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7312d8e5-31ce-4b10-8fd3-e1142a71dd71 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:48.987842 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7312d8e5-31ce-4b10-8fd3-e1142a71dd71 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:48.988295 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7312d8e5-31ce-4b10-8fd3-e1142a71dd71 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:48.989107 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7312d8e5-31ce-4b10-8fd3-e1142a71dd71 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:48.989546 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7312d8e5-31ce-4b10-8fd3-e1142a71dd71 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:49.125807 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-7312d8e5-31ce-4b10-8fd3-e1142a71dd71 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:49.135942 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-7312d8e5-31ce-4b10-8fd3-e1142a71dd71 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:49.137839 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-7312d8e5-31ce-4b10-8fd3-e1142a71dd71 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:49.139068 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7312d8e5-31ce-4b10-8fd3-e1142a71dd71 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1724 microversion: 2.20 time: 0.162391 Feb 21 01:42:49.139536 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 496/980] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:42:48 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:42:49.606046 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cc55379a-5815-4134-a52d-f9f3ca3edadf tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:49.606675 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cc55379a-5815-4134-a52d-f9f3ca3edadf tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:49.612894 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc55379a-5815-4134-a52d-f9f3ca3edadf tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:49.613335 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc55379a-5815-4134-a52d-f9f3ca3edadf tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:49.614115 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc55379a-5815-4134-a52d-f9f3ca3edadf tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:49.614543 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cc55379a-5815-4134-a52d-f9f3ca3edadf tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:49.862094 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-cc55379a-5815-4134-a52d-f9f3ca3edadf tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:49.870241 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cc55379a-5815-4134-a52d-f9f3ca3edadf tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18" status: 200 len: 1267 microversion: 2.1 time: 0.268438 Feb 21 01:42:49.871016 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 485/981] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:49 2022] GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18 => generated 1267 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:42:50.162617 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b2d1c71f-5ec2-4cd4-b055-ec5e0fd2aea9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:50.163167 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b2d1c71f-5ec2-4cd4-b055-ec5e0fd2aea9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:50.169908 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2d1c71f-5ec2-4cd4-b055-ec5e0fd2aea9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:50.170364 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2d1c71f-5ec2-4cd4-b055-ec5e0fd2aea9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:50.171144 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2d1c71f-5ec2-4cd4-b055-ec5e0fd2aea9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:50.171582 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b2d1c71f-5ec2-4cd4-b055-ec5e0fd2aea9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:50.283435 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-9dfac58b-bf57-4ba7-8f55-bb90dc7dead6 req-1d4ac451-aa43-40a7-828b-66a8b457f716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e49ba09-7813-4190-b34c-c2a6fc9c49bb", "name": "network-vif-deleted", "tag": "f62f5ef9-41f3-4a8a-abf2-f89200d260f6"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:42:50.285317 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:42:50.285317 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:42:50.294811 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-9dfac58b-bf57-4ba7-8f55-bb90dc7dead6 req-1d4ac451-aa43-40a7-828b-66a8b457f716 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:50.295256 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-9dfac58b-bf57-4ba7-8f55-bb90dc7dead6 req-1d4ac451-aa43-40a7-828b-66a8b457f716 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:50.308735 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-9dfac58b-bf57-4ba7-8f55-bb90dc7dead6 req-1d4ac451-aa43-40a7-828b-66a8b457f716 service nova] Creating event network-vif-deleted:f62f5ef9-41f3-4a8a-abf2-f89200d260f6 for instance 6e49ba09-7813-4190-b34c-c2a6fc9c49bb on hv-cinder-81322 Feb 21 01:42:50.314219 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-9dfac58b-bf57-4ba7-8f55-bb90dc7dead6 req-1d4ac451-aa43-40a7-828b-66a8b457f716 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034625 Feb 21 01:42:50.314824 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 486/982] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:42:50.389252 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b2d1c71f-5ec2-4cd4-b055-ec5e0fd2aea9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:50.397909 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b2d1c71f-5ec2-4cd4-b055-ec5e0fd2aea9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:50.399486 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b2d1c71f-5ec2-4cd4-b055-ec5e0fd2aea9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab38a084fbb643298d38c4cd8dcf87cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3acaa73503748ac9764a7eca8943882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:50.401317 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b2d1c71f-5ec2-4cd4-b055-ec5e0fd2aea9 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 200 len: 1656 microversion: 2.20 time: 0.241821 Feb 21 01:42:50.402174 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 497/983] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:42:50 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 1656 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 21 01:42:50.888781 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-150fbd26-c52b-4121-8573-b35b028d0053 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:50.889488 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-150fbd26-c52b-4121-8573-b35b028d0053 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:50.895659 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-150fbd26-c52b-4121-8573-b35b028d0053 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:50.896113 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-150fbd26-c52b-4121-8573-b35b028d0053 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:50.896990 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-150fbd26-c52b-4121-8573-b35b028d0053 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:50.897427 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-150fbd26-c52b-4121-8573-b35b028d0053 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:51.055460 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-150fbd26-c52b-4121-8573-b35b028d0053 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:51.063804 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-150fbd26-c52b-4121-8573-b35b028d0053 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18" status: 200 len: 1267 microversion: 2.1 time: 0.180380 Feb 21 01:42:51.073427 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 487/984] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:50 2022] GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:51.419752 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c8ad1bf6-cdda-4a48-b90d-0bdc78b31ed5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:51.420353 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c8ad1bf6-cdda-4a48-b90d-0bdc78b31ed5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:51.426624 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8ad1bf6-cdda-4a48-b90d-0bdc78b31ed5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:51.427062 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8ad1bf6-cdda-4a48-b90d-0bdc78b31ed5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:51.427820 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8ad1bf6-cdda-4a48-b90d-0bdc78b31ed5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:51.428246 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c8ad1bf6-cdda-4a48-b90d-0bdc78b31ed5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:51.441413 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-c8ad1bf6-cdda-4a48-b90d-0bdc78b31ed5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] HTTP exception thrown: Instance 6e49ba09-7813-4190-b34c-c2a6fc9c49bb could not be found. Feb 21 01:42:51.441986 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c8ad1bf6-cdda-4a48-b90d-0bdc78b31ed5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Returning 404 to user: Instance 6e49ba09-7813-4190-b34c-c2a6fc9c49bb could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:42:51.442800 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c8ad1bf6-cdda-4a48-b90d-0bdc78b31ed5 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 404 len: 111 microversion: 2.20 time: 0.026712 Feb 21 01:42:51.443311 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 498/985] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:42:51 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:42:51.452160 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-41a1aa06-a740-4f68-b71f-82a50f53ac9e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '.version_select at 0x7f4075eb1160>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:51.575011 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-41a1aa06-a740-4f68-b71f-82a50f53ac9e tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1844298681" status: 204 len: 0 microversion: 2.20 time: 0.127155 Feb 21 01:42:51.580820 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 488/986] 10.222.0.90 () {60 vars in 1261 bytes} [Mon Feb 21 01:42:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1844298681 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 21 01:42:52.080472 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-184614cb-4978-4479-8fb4-7763fc82a08d tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:52.081177 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-184614cb-4978-4479-8fb4-7763fc82a08d tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:52.087365 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-184614cb-4978-4479-8fb4-7763fc82a08d tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:52.087962 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-184614cb-4978-4479-8fb4-7763fc82a08d tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:52.088780 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-184614cb-4978-4479-8fb4-7763fc82a08d tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:52.089216 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-184614cb-4978-4479-8fb4-7763fc82a08d tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:52.224020 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-184614cb-4978-4479-8fb4-7763fc82a08d tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:52.231606 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-184614cb-4978-4479-8fb4-7763fc82a08d tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18" status: 200 len: 1267 microversion: 2.1 time: 0.154917 Feb 21 01:42:52.232169 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 499/987] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:52 2022] GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:53.249192 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-15be1229-2bd4-43ef-9245-e756bea274f6 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:53.249807 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-15be1229-2bd4-43ef-9245-e756bea274f6 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:53.255553 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15be1229-2bd4-43ef-9245-e756bea274f6 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:53.256001 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15be1229-2bd4-43ef-9245-e756bea274f6 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:53.256803 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15be1229-2bd4-43ef-9245-e756bea274f6 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:53.257276 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-15be1229-2bd4-43ef-9245-e756bea274f6 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:53.390286 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-15be1229-2bd4-43ef-9245-e756bea274f6 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:53.397426 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-15be1229-2bd4-43ef-9245-e756bea274f6 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18" status: 200 len: 1267 microversion: 2.1 time: 0.153196 Feb 21 01:42:53.397992 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 489/988] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:53 2022] GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:53.628849 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fe4a5e3b-8207-470e-9d4b-6d92144c0040 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:53.629342 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fe4a5e3b-8207-470e-9d4b-6d92144c0040 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:53.635470 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe4a5e3b-8207-470e-9d4b-6d92144c0040 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:53.635948 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe4a5e3b-8207-470e-9d4b-6d92144c0040 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:53.636997 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe4a5e3b-8207-470e-9d4b-6d92144c0040 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:53.637427 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fe4a5e3b-8207-470e-9d4b-6d92144c0040 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:53.651118 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-fe4a5e3b-8207-470e-9d4b-6d92144c0040 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] HTTP exception thrown: Instance 6e49ba09-7813-4190-b34c-c2a6fc9c49bb could not be found. Feb 21 01:42:53.651711 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fe4a5e3b-8207-470e-9d4b-6d92144c0040 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Returning 404 to user: Instance 6e49ba09-7813-4190-b34c-c2a6fc9c49bb could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:42:53.652560 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fe4a5e3b-8207-470e-9d4b-6d92144c0040 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "DELETE /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 404 len: 111 microversion: 2.20 time: 0.027531 Feb 21 01:42:53.653104 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 500/989] 10.222.0.90 () {60 vars in 1279 bytes} [Mon Feb 21 01:42:53 2022] DELETE /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:42:53.660897 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4640afd0-9b45-4545-b3da-1248f532517f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:53.661513 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-4640afd0-9b45-4545-b3da-1248f532517f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 6e49ba09-7813-4190-b34c-c2a6fc9c49bb] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:53.667935 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4640afd0-9b45-4545-b3da-1248f532517f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:53.668388 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4640afd0-9b45-4545-b3da-1248f532517f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:53.669182 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4640afd0-9b45-4545-b3da-1248f532517f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:53.669622 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-4640afd0-9b45-4545-b3da-1248f532517f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:53.685768 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-4640afd0-9b45-4545-b3da-1248f532517f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] HTTP exception thrown: Instance 6e49ba09-7813-4190-b34c-c2a6fc9c49bb could not be found. Feb 21 01:42:53.686355 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-4640afd0-9b45-4545-b3da-1248f532517f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Returning 404 to user: Instance 6e49ba09-7813-4190-b34c-c2a6fc9c49bb could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:42:53.687185 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4640afd0-9b45-4545-b3da-1248f532517f tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb" status: 404 len: 111 microversion: 2.20 time: 0.030015 Feb 21 01:42:53.687725 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 490/990] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:42:53 2022] GET /compute/v2.1/servers/6e49ba09-7813-4190-b34c-c2a6fc9c49bb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:42:54.414378 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-22086d6e-9471-4f81-a7b4-cd6b3eba3302 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:54.414988 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-22086d6e-9471-4f81-a7b4-cd6b3eba3302 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:54.421272 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22086d6e-9471-4f81-a7b4-cd6b3eba3302 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:54.421719 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22086d6e-9471-4f81-a7b4-cd6b3eba3302 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:54.422488 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22086d6e-9471-4f81-a7b4-cd6b3eba3302 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:54.422918 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-22086d6e-9471-4f81-a7b4-cd6b3eba3302 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:54.631037 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-22086d6e-9471-4f81-a7b4-cd6b3eba3302 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:54.639834 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-22086d6e-9471-4f81-a7b4-cd6b3eba3302 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18" status: 200 len: 1267 microversion: 2.1 time: 0.229102 Feb 21 01:42:54.640545 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 501/991] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:54 2022] GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18 => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:42:54.960811 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0d2250d5-df1b-4f5b-b95e-4a88277ee8e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:54.961324 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0d2250d5-df1b-4f5b-b95e-4a88277ee8e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:54.967588 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d2250d5-df1b-4f5b-b95e-4a88277ee8e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:54.968040 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d2250d5-df1b-4f5b-b95e-4a88277ee8e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:54.968854 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d2250d5-df1b-4f5b-b95e-4a88277ee8e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:54.969286 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0d2250d5-df1b-4f5b-b95e-4a88277ee8e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:54.982674 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-0d2250d5-df1b-4f5b-b95e-4a88277ee8e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] HTTP exception thrown: Instance 962b0526-5a3e-4044-a74f-34fe41f7717d could not be found. Feb 21 01:42:54.983286 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0d2250d5-df1b-4f5b-b95e-4a88277ee8e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Returning 404 to user: Instance 962b0526-5a3e-4044-a74f-34fe41f7717d could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:42:54.984115 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0d2250d5-df1b-4f5b-b95e-4a88277ee8e2 tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "DELETE /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 404 len: 111 microversion: 2.20 time: 0.027417 Feb 21 01:42:54.984782 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 491/992] 10.222.0.90 () {60 vars in 1279 bytes} [Mon Feb 21 01:42:54 2022] DELETE /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:42:54.992840 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aa88ca11-5ce7-4b27-a020-7eef6a82faaa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:54.993463 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-aa88ca11-5ce7-4b27-a020-7eef6a82faaa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] [instance: 962b0526-5a3e-4044-a74f-34fe41f7717d] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:55.000231 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa88ca11-5ce7-4b27-a020-7eef6a82faaa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:55.000730 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa88ca11-5ce7-4b27-a020-7eef6a82faaa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:55.001535 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa88ca11-5ce7-4b27-a020-7eef6a82faaa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:55.001968 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-aa88ca11-5ce7-4b27-a020-7eef6a82faaa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:55.017376 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-aa88ca11-5ce7-4b27-a020-7eef6a82faaa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] HTTP exception thrown: Instance 962b0526-5a3e-4044-a74f-34fe41f7717d could not be found. Feb 21 01:42:55.017971 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-aa88ca11-5ce7-4b27-a020-7eef6a82faaa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] Returning 404 to user: Instance 962b0526-5a3e-4044-a74f-34fe41f7717d could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:42:55.018805 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-aa88ca11-5ce7-4b27-a020-7eef6a82faaa tempest-AttachVolumeShelveTestJSON-1802145685 tempest-AttachVolumeShelveTestJSON-1802145685-project] 10.222.0.90 "GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d" status: 404 len: 111 microversion: 2.20 time: 0.029907 Feb 21 01:42:55.019380 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 502/993] 10.222.0.90 () {60 vars in 1276 bytes} [Mon Feb 21 01:42:54 2022] GET /compute/v2.1/servers/962b0526-5a3e-4044-a74f-34fe41f7717d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:42:55.657139 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-43260a3c-b824-4555-812c-49c20ce61f61 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:55.657752 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-43260a3c-b824-4555-812c-49c20ce61f61 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:55.663595 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43260a3c-b824-4555-812c-49c20ce61f61 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:55.664155 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43260a3c-b824-4555-812c-49c20ce61f61 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:55.665064 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43260a3c-b824-4555-812c-49c20ce61f61 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:55.665730 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-43260a3c-b824-4555-812c-49c20ce61f61 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:55.904995 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-43260a3c-b824-4555-812c-49c20ce61f61 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:55.913354 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-43260a3c-b824-4555-812c-49c20ce61f61 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18" status: 200 len: 1267 microversion: 2.1 time: 0.259905 Feb 21 01:42:55.923337 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 492/994] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:55 2022] GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18 => generated 1267 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:56.930151 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-777e2429-5d7a-49cc-a76d-991e4c76c2ff tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:56.932056 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-777e2429-5d7a-49cc-a76d-991e4c76c2ff tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:56.955855 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-777e2429-5d7a-49cc-a76d-991e4c76c2ff tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:56.956778 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-777e2429-5d7a-49cc-a76d-991e4c76c2ff tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:56.958227 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-777e2429-5d7a-49cc-a76d-991e4c76c2ff tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:56.959287 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-777e2429-5d7a-49cc-a76d-991e4c76c2ff tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:57.117348 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-777e2429-5d7a-49cc-a76d-991e4c76c2ff tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:57.126480 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-777e2429-5d7a-49cc-a76d-991e4c76c2ff tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18" status: 200 len: 1267 microversion: 2.1 time: 0.199990 Feb 21 01:42:57.128785 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 503/995] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:56 2022] GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18 => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:57.924336 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-9830c97a-aba9-4a5e-81b4-e18f9f4716e4 req-99407df7-c159-4b64-9961-6f1afaeac734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28ebc3bf-d635-4c37-869a-261c9ec07c18", "name": "network-vif-plugged", "status": "completed", "tag": "75fcf9e4-d75d-42b6-a1f3-4f77b840ca06"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:42:57.926512 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:42:57.926512 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:42:57.934799 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-9830c97a-aba9-4a5e-81b4-e18f9f4716e4 req-99407df7-c159-4b64-9961-6f1afaeac734 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:57.935248 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-9830c97a-aba9-4a5e-81b4-e18f9f4716e4 req-99407df7-c159-4b64-9961-6f1afaeac734 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:57.946691 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-9830c97a-aba9-4a5e-81b4-e18f9f4716e4 req-99407df7-c159-4b64-9961-6f1afaeac734 service nova] Creating event network-vif-plugged:75fcf9e4-d75d-42b6-a1f3-4f77b840ca06 for instance 28ebc3bf-d635-4c37-869a-261c9ec07c18 on hv-cinder-81322 Feb 21 01:42:57.951841 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-9830c97a-aba9-4a5e-81b4-e18f9f4716e4 req-99407df7-c159-4b64-9961-6f1afaeac734 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031968 Feb 21 01:42:57.952814 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 493/996] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:42:58.146669 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bea8313d-3c80-4978-afc8-15b6323095e8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:58.148065 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bea8313d-3c80-4978-afc8-15b6323095e8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:58.160346 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bea8313d-3c80-4978-afc8-15b6323095e8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:58.160848 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bea8313d-3c80-4978-afc8-15b6323095e8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:58.165248 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bea8313d-3c80-4978-afc8-15b6323095e8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:58.165248 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bea8313d-3c80-4978-afc8-15b6323095e8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:58.441071 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-bea8313d-3c80-4978-afc8-15b6323095e8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:58.453965 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bea8313d-3c80-4978-afc8-15b6323095e8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18" status: 200 len: 1267 microversion: 2.1 time: 0.311065 Feb 21 01:42:58.455488 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 504/997] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:58 2022] GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18 => generated 1267 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:42:59.479998 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-971d543a-bfd5-464c-a60b-db8a9af15995 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:42:59.480801 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-971d543a-bfd5-464c-a60b-db8a9af15995 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:42:59.486932 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-971d543a-bfd5-464c-a60b-db8a9af15995 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:59.487316 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-971d543a-bfd5-464c-a60b-db8a9af15995 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:59.488175 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-971d543a-bfd5-464c-a60b-db8a9af15995 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:42:59.488859 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-971d543a-bfd5-464c-a60b-db8a9af15995 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:42:59.624847 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-971d543a-bfd5-464c-a60b-db8a9af15995 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:42:59.632539 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-971d543a-bfd5-464c-a60b-db8a9af15995 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18" status: 200 len: 1267 microversion: 2.1 time: 0.157320 Feb 21 01:42:59.641545 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 494/998] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:42:59 2022] GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:00.648538 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d4695f9e-4cd9-40a8-961d-1c21eb4db96c tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:00.649155 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d4695f9e-4cd9-40a8-961d-1c21eb4db96c tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:00.655894 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4695f9e-4cd9-40a8-961d-1c21eb4db96c tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:00.656345 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4695f9e-4cd9-40a8-961d-1c21eb4db96c tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:00.657159 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4695f9e-4cd9-40a8-961d-1c21eb4db96c tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:00.657593 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d4695f9e-4cd9-40a8-961d-1c21eb4db96c tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:00.799687 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-d4695f9e-4cd9-40a8-961d-1c21eb4db96c tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:00.812170 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d4695f9e-4cd9-40a8-961d-1c21eb4db96c tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18" status: 200 len: 1454 microversion: 2.1 time: 0.162816 Feb 21 01:43:00.812170 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 505/999] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:00 2022] GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18 => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:00.826360 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-890cbafc-e0c6-43d0-a6d0-d6e25a10dba7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:00.827235 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-890cbafc-e0c6-43d0-a6d0-d6e25a10dba7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:00.833584 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-890cbafc-e0c6-43d0-a6d0-d6e25a10dba7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:00.834038 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-890cbafc-e0c6-43d0-a6d0-d6e25a10dba7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:00.834813 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-890cbafc-e0c6-43d0-a6d0-d6e25a10dba7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:00.835252 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-890cbafc-e0c6-43d0-a6d0-d6e25a10dba7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:00.985417 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-890cbafc-e0c6-43d0-a6d0-d6e25a10dba7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:00.993731 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-890cbafc-e0c6-43d0-a6d0-d6e25a10dba7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18" status: 200 len: 1454 microversion: 2.1 time: 0.171386 Feb 21 01:43:00.994745 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 495/1000] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:00 2022] GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18 => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:43:01.201967 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1a10b152-dd39-488c-84dd-4cbfafa1da75 tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] Action: 'create', calling method: .version_select at 0x7f4075b91790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2083773547"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:43:01.976946 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1a10b152-dd39-488c-84dd-4cbfafa1da75 tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.886307 Feb 21 01:43:01.976946 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 506/1001] 10.222.0.90 () {60 vars in 1154 bytes} [Mon Feb 21 01:43:01 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 888 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Feb 21 01:43:01.986273 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a193f531-ff35-469f-a7bd-ac88e7ef6c9e tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] Calling method '.version_select at 0x7f4075edea60>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:02.033388 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a193f531-ff35-469f-a7bd-ac88e7ef6c9e tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/3cb42333-d6d9-4882-968d-4c48bd9bca43" status: 200 len: 345 microversion: 2.1 time: 0.050299 Feb 21 01:43:02.034231 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 496/1002] 10.222.0.90 () {58 vars in 1244 bytes} [Mon Feb 21 01:43:01 2022] GET /compute/v2.1/os-volumes/3cb42333-d6d9-4882-968d-4c48bd9bca43 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:43:03.046808 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-51254e19-f7b2-49cc-b9a6-374696178585 tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] Calling method '.version_select at 0x7f4075bb04c0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:03.091514 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-51254e19-f7b2-49cc-b9a6-374696178585 tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/3cb42333-d6d9-4882-968d-4c48bd9bca43" status: 200 len: 346 microversion: 2.1 time: 0.048713 Feb 21 01:43:03.092305 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 507/1003] 10.222.0.90 () {58 vars in 1244 bytes} [Mon Feb 21 01:43:03 2022] GET /compute/v2.1/os-volumes/3cb42333-d6d9-4882-968d-4c48bd9bca43 => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:43:03.104027 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-55dfa4ed-ec44-4950-a96c-9956023e96a6 tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] Action: 'create', calling method: .version_select at 0x7f4075b13f70>, body: {"snapshot": {"volume_id": "3cb42333-d6d9-4882-968d-4c48bd9bca43", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2035747072"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:43:03.560661 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-b22f180b-9634-488c-b6d5-eab7213793fb req-81941ab2-c610-4cb4-b327-37060fa8107d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28ebc3bf-d635-4c37-869a-261c9ec07c18", "tag": "75fcf9e4-d75d-42b6-a1f3-4f77b840ca06"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:43:03.565592 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:43:03.565592 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:43:03.570971 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b22f180b-9634-488c-b6d5-eab7213793fb req-81941ab2-c610-4cb4-b327-37060fa8107d service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:03.571540 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-b22f180b-9634-488c-b6d5-eab7213793fb req-81941ab2-c610-4cb4-b327-37060fa8107d service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:03.582557 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-b22f180b-9634-488c-b6d5-eab7213793fb req-81941ab2-c610-4cb4-b327-37060fa8107d service nova] Creating event network-changed:75fcf9e4-d75d-42b6-a1f3-4f77b840ca06 for instance 28ebc3bf-d635-4c37-869a-261c9ec07c18 on hv-cinder-81322 Feb 21 01:43:03.588762 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-b22f180b-9634-488c-b6d5-eab7213793fb req-81941ab2-c610-4cb4-b327-37060fa8107d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031100 Feb 21 01:43:03.591502 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 508/1004] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:43:03.817387 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-55dfa4ed-ec44-4950-a96c-9956023e96a6 tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] 10.222.0.90 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.712512 Feb 21 01:43:03.817387 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 497/1005] 10.222.0.90 () {60 vars in 1161 bytes} [Mon Feb 21 01:43:03 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:43:03.823471 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f9dfcb18-1e5d-48f4-a894-9d27202477ed tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] Calling method '.version_select at 0x7f4075bcf820>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:03.853907 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f9dfcb18-1e5d-48f4-a894-9d27202477ed tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/392017ec-0a44-4238-9084-f222305488b5" status: 200 len: 287 microversion: 2.1 time: 0.035221 Feb 21 01:43:03.854473 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 509/1006] 10.222.0.90 () {58 vars in 1250 bytes} [Mon Feb 21 01:43:03 2022] GET /compute/v2.1/os-snapshots/392017ec-0a44-4238-9084-f222305488b5 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:43:03.864052 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ebecbe1a-da92-4e9c-820f-6075f883a0bb tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] Calling method '.version_select at 0x7f4075eb1af0>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:03.892861 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ebecbe1a-da92-4e9c-820f-6075f883a0bb tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.032395 Feb 21 01:43:03.893492 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 498/1007] 10.222.0.90 () {58 vars in 1139 bytes} [Mon Feb 21 01:43:03 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:43:03.903564 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d342452a-9621-4396-b3bb-4de1b0308ab6 tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] Calling method '.version_select at 0x7f4075bfeb80>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:03.936901 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d342452a-9621-4396-b3bb-4de1b0308ab6 tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/392017ec-0a44-4238-9084-f222305488b5" status: 200 len: 287 microversion: 2.1 time: 0.037373 Feb 21 01:43:03.937467 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 510/1008] 10.222.0.90 () {58 vars in 1250 bytes} [Mon Feb 21 01:43:03 2022] GET /compute/v2.1/os-snapshots/392017ec-0a44-4238-9084-f222305488b5 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:43:04.949400 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b234b6bb-1a1f-4478-9a20-5abe3ac200b9 tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] Calling method '.version_select at 0x7f4075d16310>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:04.976178 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b234b6bb-1a1f-4478-9a20-5abe3ac200b9 tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/392017ec-0a44-4238-9084-f222305488b5" status: 200 len: 287 microversion: 2.1 time: 0.031555 Feb 21 01:43:04.976761 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 499/1009] 10.222.0.90 () {58 vars in 1250 bytes} [Mon Feb 21 01:43:04 2022] GET /compute/v2.1/os-snapshots/392017ec-0a44-4238-9084-f222305488b5 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:43:05.987618 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8ef0fd7c-25f9-4f90-a44f-5371620c1eb2 tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] Calling method '.version_select at 0x7f4075bfd4c0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:06.015819 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8ef0fd7c-25f9-4f90-a44f-5371620c1eb2 tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/392017ec-0a44-4238-9084-f222305488b5" status: 200 len: 287 microversion: 2.1 time: 0.032215 Feb 21 01:43:06.016358 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 511/1010] 10.222.0.90 () {58 vars in 1250 bytes} [Mon Feb 21 01:43:05 2022] GET /compute/v2.1/os-snapshots/392017ec-0a44-4238-9084-f222305488b5 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:43:07.028082 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ec19a3d3-46ab-413f-b962-e98f36a2d00a tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] Calling method '.version_select at 0x7f4075e94430>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:07.055201 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ec19a3d3-46ab-413f-b962-e98f36a2d00a tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/392017ec-0a44-4238-9084-f222305488b5" status: 200 len: 287 microversion: 2.1 time: 0.031690 Feb 21 01:43:07.055748 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 500/1011] 10.222.0.90 () {58 vars in 1250 bytes} [Mon Feb 21 01:43:07 2022] GET /compute/v2.1/os-snapshots/392017ec-0a44-4238-9084-f222305488b5 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:43:08.067439 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e1fa3e7b-5621-4177-b8c5-ae1e6c333127 tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] Calling method '.version_select at 0x7f4075bfef70>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:08.094758 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e1fa3e7b-5621-4177-b8c5-ae1e6c333127 tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/392017ec-0a44-4238-9084-f222305488b5" status: 200 len: 288 microversion: 2.1 time: 0.031533 Feb 21 01:43:08.095308 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 512/1012] 10.222.0.90 () {58 vars in 1250 bytes} [Mon Feb 21 01:43:08 2022] GET /compute/v2.1/os-snapshots/392017ec-0a44-4238-9084-f222305488b5 => generated 288 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:43:08.106564 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6ce6ed08-31d5-4e53-9b21-5ee738980daf tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] Calling method '.version_select at 0x7f4075ede310>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:08.233330 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6ce6ed08-31d5-4e53-9b21-5ee738980daf tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] 10.222.0.90 "DELETE /compute/v2.1/os-snapshots/392017ec-0a44-4238-9084-f222305488b5" status: 202 len: 0 microversion: 2.1 time: 0.131384 Feb 21 01:43:08.233905 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 501/1013] 10.222.0.90 () {58 vars in 1253 bytes} [Mon Feb 21 01:43:08 2022] DELETE /compute/v2.1/os-snapshots/392017ec-0a44-4238-9084-f222305488b5 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:43:08.242221 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-009c610d-3a02-4238-9e95-2969e40846ee tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] Calling method '.version_select at 0x7f4075bf61f0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:08.269996 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-009c610d-3a02-4238-9e95-2969e40846ee tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/392017ec-0a44-4238-9084-f222305488b5" status: 200 len: 287 microversion: 2.1 time: 0.031493 Feb 21 01:43:08.270539 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 513/1014] 10.222.0.90 () {58 vars in 1250 bytes} [Mon Feb 21 01:43:08 2022] GET /compute/v2.1/os-snapshots/392017ec-0a44-4238-9084-f222305488b5 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:43:09.281801 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-66f5fd5e-c646-42b1-add6-d754df07abce tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] Calling method '.version_select at 0x7f4075c45820>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:09.305034 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-66f5fd5e-c646-42b1-add6-d754df07abce tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] HTTP exception thrown: Snapshot 392017ec-0a44-4238-9084-f222305488b5 could not be found. Feb 21 01:43:09.305625 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-66f5fd5e-c646-42b1-add6-d754df07abce tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] Returning 404 to user: Snapshot 392017ec-0a44-4238-9084-f222305488b5 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:43:09.306946 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-66f5fd5e-c646-42b1-add6-d754df07abce tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/392017ec-0a44-4238-9084-f222305488b5" status: 404 len: 111 microversion: 2.1 time: 0.029400 Feb 21 01:43:09.307479 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 502/1015] 10.222.0.90 () {58 vars in 1250 bytes} [Mon Feb 21 01:43:09 2022] GET /compute/v2.1/os-snapshots/392017ec-0a44-4238-9084-f222305488b5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:43:09.315897 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2a142ab7-40eb-4f54-821a-7e3ff99c2057 tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] Calling method '.version_select at 0x7f4075ba19d0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:09.481817 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2a142ab7-40eb-4f54-821a-7e3ff99c2057 tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/3cb42333-d6d9-4882-968d-4c48bd9bca43" status: 202 len: 0 microversion: 2.1 time: 0.169884 Feb 21 01:43:09.482416 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 514/1016] 10.222.0.90 () {58 vars in 1247 bytes} [Mon Feb 21 01:43:09 2022] DELETE /compute/v2.1/os-volumes/3cb42333-d6d9-4882-968d-4c48bd9bca43 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:43:09.491014 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-74349487-6a6d-42db-be4a-1c2a78333068 tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] Calling method '.version_select at 0x7f40780dfd30>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:09.536190 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-74349487-6a6d-42db-be4a-1c2a78333068 tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/3cb42333-d6d9-4882-968d-4c48bd9bca43" status: 200 len: 345 microversion: 2.1 time: 0.048759 Feb 21 01:43:09.536789 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 503/1017] 10.222.0.90 () {58 vars in 1244 bytes} [Mon Feb 21 01:43:09 2022] GET /compute/v2.1/os-volumes/3cb42333-d6d9-4882-968d-4c48bd9bca43 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:43:10.549582 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-25394e42-5531-4c2e-a052-bf05af896d68 tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] Calling method '.version_select at 0x7f4075b628b0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:10.575004 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-25394e42-5531-4c2e-a052-bf05af896d68 tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] HTTP exception thrown: Volume 3cb42333-d6d9-4882-968d-4c48bd9bca43 could not be found. Feb 21 01:43:10.575591 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-25394e42-5531-4c2e-a052-bf05af896d68 tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] Returning 404 to user: Volume 3cb42333-d6d9-4882-968d-4c48bd9bca43 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:43:10.576398 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-25394e42-5531-4c2e-a052-bf05af896d68 tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/3cb42333-d6d9-4882-968d-4c48bd9bca43" status: 404 len: 109 microversion: 2.1 time: 0.031112 Feb 21 01:43:10.576949 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 515/1018] 10.222.0.90 () {58 vars in 1244 bytes} [Mon Feb 21 01:43:10 2022] GET /compute/v2.1/os-volumes/3cb42333-d6d9-4882-968d-4c48bd9bca43 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:43:10.586442 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-06b38014-91f0-49c0-add4-dbc4e80c2a3f tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] Calling method '.version_select at 0x7f4075ede160>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:10.612817 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-06b38014-91f0-49c0-add4-dbc4e80c2a3f tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] HTTP exception thrown: Volume 3cb42333-d6d9-4882-968d-4c48bd9bca43 could not be found. Feb 21 01:43:10.613676 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-06b38014-91f0-49c0-add4-dbc4e80c2a3f tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] Returning 404 to user: Volume 3cb42333-d6d9-4882-968d-4c48bd9bca43 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:43:10.615046 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-06b38014-91f0-49c0-add4-dbc4e80c2a3f tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/3cb42333-d6d9-4882-968d-4c48bd9bca43" status: 404 len: 109 microversion: 2.1 time: 0.032502 Feb 21 01:43:10.615857 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 504/1019] 10.222.0.90 () {58 vars in 1247 bytes} [Mon Feb 21 01:43:10 2022] DELETE /compute/v2.1/os-volumes/3cb42333-d6d9-4882-968d-4c48bd9bca43 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:43:10.626803 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-efd7aee9-21ed-4245-9d10-5e6825eb57cb tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] Calling method '.version_select at 0x7f4075bfe9d0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:10.660593 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-efd7aee9-21ed-4245-9d10-5e6825eb57cb tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] HTTP exception thrown: Volume 3cb42333-d6d9-4882-968d-4c48bd9bca43 could not be found. Feb 21 01:43:10.661254 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-efd7aee9-21ed-4245-9d10-5e6825eb57cb tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] Returning 404 to user: Volume 3cb42333-d6d9-4882-968d-4c48bd9bca43 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:43:10.662340 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-efd7aee9-21ed-4245-9d10-5e6825eb57cb tempest-VolumesSnapshotsTestJSON-1772763020 tempest-VolumesSnapshotsTestJSON-1772763020-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/3cb42333-d6d9-4882-968d-4c48bd9bca43" status: 404 len: 109 microversion: 2.1 time: 0.040489 Feb 21 01:43:10.662628 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 516/1020] 10.222.0.90 () {58 vars in 1244 bytes} [Mon Feb 21 01:43:10 2022] GET /compute/v2.1/os-volumes/3cb42333-d6d9-4882-968d-4c48bd9bca43 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 21 01:43:12.750489 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1f655b00-f647-4670-bf22-d488e82030a1 tempest-VolumesNegativeTest-96353605 tempest-VolumesNegativeTest-96353605-project] Action: 'create', calling method: .version_select at 0x7f4075be2040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1142729587", "metadata": {"Type": "work"}}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:43:12.751861 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1f655b00-f647-4670-bf22-d488e82030a1 tempest-VolumesNegativeTest-96353605 tempest-VolumesNegativeTest-96353605-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:43:12.752686 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1f655b00-f647-4670-bf22-d488e82030a1 tempest-VolumesNegativeTest-96353605 tempest-VolumesNegativeTest-96353605-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.119349 Feb 21 01:43:12.753205 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 505/1021] 10.222.0.90 () {60 vars in 1155 bytes} [Mon Feb 21 01:43:12 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:43:12.762730 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a7f34d17-fe3f-4230-afea-7f8908c8c081 tempest-VolumesNegativeTest-96353605 tempest-VolumesNegativeTest-96353605-project] Action: 'create', calling method: .version_select at 0x7f4075b91430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1146482159", "metadata": {"Type": "work"}}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:43:12.764140 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a7f34d17-fe3f-4230-afea-7f8908c8c081 tempest-VolumesNegativeTest-96353605 tempest-VolumesNegativeTest-96353605-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:43:12.764960 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a7f34d17-fe3f-4230-afea-7f8908c8c081 tempest-VolumesNegativeTest-96353605 tempest-VolumesNegativeTest-96353605-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006709 Feb 21 01:43:12.765460 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 517/1022] 10.222.0.90 () {60 vars in 1155 bytes} [Mon Feb 21 01:43:12 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:43:12.773209 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bd341850-d05d-43ee-9621-b237d5fb69bb tempest-VolumesNegativeTest-96353605 tempest-VolumesNegativeTest-96353605-project] Action: 'create', calling method: .version_select at 0x7f4075ede5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1582625063", "metadata": {"Type": "work"}}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:43:12.774311 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bd341850-d05d-43ee-9621-b237d5fb69bb tempest-VolumesNegativeTest-96353605 tempest-VolumesNegativeTest-96353605-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:43:12.775107 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bd341850-d05d-43ee-9621-b237d5fb69bb tempest-VolumesNegativeTest-96353605 tempest-VolumesNegativeTest-96353605-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005298 Feb 21 01:43:12.775606 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 506/1023] 10.222.0.90 () {60 vars in 1155 bytes} [Mon Feb 21 01:43:12 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 6 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 21 01:43:12.784027 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dc6ceb20-4a27-442b-844f-f6de2409f391 tempest-VolumesNegativeTest-96353605 tempest-VolumesNegativeTest-96353605-project] Calling method '.version_select at 0x7f4075b62dc0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:12.810955 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-dc6ceb20-4a27-442b-844f-f6de2409f391 tempest-VolumesNegativeTest-96353605 tempest-VolumesNegativeTest-96353605-project] HTTP exception thrown: Volume tempest-invalid-1062654606 could not be found. Feb 21 01:43:12.811551 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-dc6ceb20-4a27-442b-844f-f6de2409f391 tempest-VolumesNegativeTest-96353605 tempest-VolumesNegativeTest-96353605-project] Returning 404 to user: Volume tempest-invalid-1062654606 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:43:12.812374 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-dc6ceb20-4a27-442b-844f-f6de2409f391 tempest-VolumesNegativeTest-96353605 tempest-VolumesNegativeTest-96353605-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1062654606" status: 404 len: 99 microversion: 2.1 time: 0.032287 Feb 21 01:43:12.813083 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 518/1024] 10.222.0.90 () {58 vars in 1217 bytes} [Mon Feb 21 01:43:12 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1062654606 => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 21 01:43:12.826901 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-4c3ba6f5-ad9b-46dc-9ad1-7a3b350f988d tempest-VolumesNegativeTest-96353605 tempest-VolumesNegativeTest-96353605-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003634 Feb 21 01:43:12.827399 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 507/1025] 10.222.0.90 () {58 vars in 1139 bytes} [Mon Feb 21 01:43:12 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 21 01:43:12.835931 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-24ea9624-d4e6-4dde-9b72-4532d1858707 tempest-VolumesNegativeTest-96353605 tempest-VolumesNegativeTest-96353605-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003632 Feb 21 01:43:12.836441 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 519/1026] 10.222.0.90 () {58 vars in 1136 bytes} [Mon Feb 21 01:43:12 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Feb 21 01:43:12.846843 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cf9ddb0b-8cc5-44ca-a94b-88fc133a7748 tempest-VolumesNegativeTest-96353605 tempest-VolumesNegativeTest-96353605-project] Calling method '.version_select at 0x7f407690f040>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:12.876530 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-cf9ddb0b-8cc5-44ca-a94b-88fc133a7748 tempest-VolumesNegativeTest-96353605 tempest-VolumesNegativeTest-96353605-project] HTTP exception thrown: Volume 7f7c087c-7fca-430a-918a-b7d6ab6b859c could not be found. Feb 21 01:43:12.877131 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cf9ddb0b-8cc5-44ca-a94b-88fc133a7748 tempest-VolumesNegativeTest-96353605 tempest-VolumesNegativeTest-96353605-project] Returning 404 to user: Volume 7f7c087c-7fca-430a-918a-b7d6ab6b859c could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:43:12.877968 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cf9ddb0b-8cc5-44ca-a94b-88fc133a7748 tempest-VolumesNegativeTest-96353605 tempest-VolumesNegativeTest-96353605-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/7f7c087c-7fca-430a-918a-b7d6ab6b859c" status: 404 len: 109 microversion: 2.1 time: 0.036674 Feb 21 01:43:12.878511 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 508/1027] 10.222.0.90 () {58 vars in 1247 bytes} [Mon Feb 21 01:43:12 2022] DELETE /compute/v2.1/os-volumes/7f7c087c-7fca-430a-918a-b7d6ab6b859c => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:43:12.887763 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6c79c173-f3d9-41de-b24d-5b94aecc8662 tempest-VolumesNegativeTest-96353605 tempest-VolumesNegativeTest-96353605-project] Calling method '.version_select at 0x7f4075bf61f0>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:12.917632 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-6c79c173-f3d9-41de-b24d-5b94aecc8662 tempest-VolumesNegativeTest-96353605 tempest-VolumesNegativeTest-96353605-project] HTTP exception thrown: Volume d5fc6d07-3d33-4321-82f2-58b1663c6482 could not be found. Feb 21 01:43:12.918301 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6c79c173-f3d9-41de-b24d-5b94aecc8662 tempest-VolumesNegativeTest-96353605 tempest-VolumesNegativeTest-96353605-project] Returning 404 to user: Volume d5fc6d07-3d33-4321-82f2-58b1663c6482 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:43:12.919201 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6c79c173-f3d9-41de-b24d-5b94aecc8662 tempest-VolumesNegativeTest-96353605 tempest-VolumesNegativeTest-96353605-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/d5fc6d07-3d33-4321-82f2-58b1663c6482" status: 404 len: 109 microversion: 2.1 time: 0.035625 Feb 21 01:43:12.919838 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 520/1028] 10.222.0.90 () {58 vars in 1244 bytes} [Mon Feb 21 01:43:12 2022] GET /compute/v2.1/os-volumes/d5fc6d07-3d33-4321-82f2-58b1663c6482 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:43:19.687228 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c7d6c492-32b7-43ac-a011-d93e875760b6 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1434012376", "imageRef": "35936a71-5ec3-4154-b01a-f2dafd8c0364", "flavorRef": "452", "networks": [{"uuid": "5f5b61d0-749a-42d6-a36d-902db889b48a"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:43:19.740526 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-c7d6c492-32b7-43ac-a011-d93e875760b6 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] validate_networks() for [('5f5b61d0-749a-42d6-a36d-902db889b48a', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:43:20.095280 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c7d6c492-32b7-43ac-a011-d93e875760b6 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:43:20.095768 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c7d6c492-32b7-43ac-a011-d93e875760b6 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:43:20.096234 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c7d6c492-32b7-43ac-a011-d93e875760b6 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:43:20.096691 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c7d6c492-32b7-43ac-a011-d93e875760b6 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:43:20.097118 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-c7d6c492-32b7-43ac-a011-d93e875760b6 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:43:20.106017 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7d6c492-32b7-43ac-a011-d93e875760b6 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:20.106448 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7d6c492-32b7-43ac-a011-d93e875760b6 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:20.107246 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7d6c492-32b7-43ac-a011-d93e875760b6 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:20.107702 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c7d6c492-32b7-43ac-a011-d93e875760b6 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:20.123889 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-c7d6c492-32b7-43ac-a011-d93e875760b6 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Getting quotas for project eee074218f5d45c09d213dc996c172b5. Resources: {'ram', 'cores', 'instances'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:43:20.127693 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-c7d6c492-32b7-43ac-a011-d93e875760b6 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Getting quotas for user 9e6600897456464a8af678bd97146ebf and project eee074218f5d45c09d213dc996c172b5. Resources: {'ram', 'cores', 'instances'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:43:20.138303 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c7d6c492-32b7-43ac-a011-d93e875760b6 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:43:20.140564 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c7d6c492-32b7-43ac-a011-d93e875760b6 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: f462aba2-e204-42e0-8f1a-cc25b075bdb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35936a71-5ec3-4154-b01a-f2dafd8c0364',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:43:20.280384 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c7d6c492-32b7-43ac-a011-d93e875760b6 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599663 Feb 21 01:43:20.281195 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 509/1029] 10.222.0.90 () {60 vars in 1146 bytes} [Mon Feb 21 01:43:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:43:20.291983 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-588c3b9c-24c6-42cf-9318-67f4661bd3e4 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:20.292865 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-588c3b9c-24c6-42cf-9318-67f4661bd3e4 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: f462aba2-e204-42e0-8f1a-cc25b075bdb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:20.347581 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-588c3b9c-24c6-42cf-9318-67f4661bd3e4 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:20.354078 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-588c3b9c-24c6-42cf-9318-67f4661bd3e4 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9" status: 200 len: 1219 microversion: 2.1 time: 0.066430 Feb 21 01:43:20.355049 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 521/1030] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:20 2022] GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:21.371755 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-80be1500-da50-4222-943d-3e8cbf65c435 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:21.373047 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-80be1500-da50-4222-943d-3e8cbf65c435 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: f462aba2-e204-42e0-8f1a-cc25b075bdb9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:21.378943 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80be1500-da50-4222-943d-3e8cbf65c435 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:21.379393 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80be1500-da50-4222-943d-3e8cbf65c435 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:21.380176 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80be1500-da50-4222-943d-3e8cbf65c435 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:21.380641 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-80be1500-da50-4222-943d-3e8cbf65c435 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:21.443528 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-80be1500-da50-4222-943d-3e8cbf65c435 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:21.450887 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-80be1500-da50-4222-943d-3e8cbf65c435 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9" status: 200 len: 1223 microversion: 2.1 time: 0.083285 Feb 21 01:43:21.451679 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 510/1031] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:21 2022] GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:43:22.468301 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bdefdd72-7b54-4eec-8004-83579dc7d6c7 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:22.469274 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bdefdd72-7b54-4eec-8004-83579dc7d6c7 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: f462aba2-e204-42e0-8f1a-cc25b075bdb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:22.475737 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bdefdd72-7b54-4eec-8004-83579dc7d6c7 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:22.476172 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bdefdd72-7b54-4eec-8004-83579dc7d6c7 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:22.477297 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bdefdd72-7b54-4eec-8004-83579dc7d6c7 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:22.477721 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bdefdd72-7b54-4eec-8004-83579dc7d6c7 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:22.553517 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-bdefdd72-7b54-4eec-8004-83579dc7d6c7 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:22.561462 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bdefdd72-7b54-4eec-8004-83579dc7d6c7 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9" status: 200 len: 1279 microversion: 2.1 time: 0.097553 Feb 21 01:43:22.562266 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 522/1032] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:22 2022] GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9 => generated 1279 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:23.579444 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1ba1357e-8508-45c0-a796-12e1dc5d46f2 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:23.580058 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1ba1357e-8508-45c0-a796-12e1dc5d46f2 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: f462aba2-e204-42e0-8f1a-cc25b075bdb9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:23.586775 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ba1357e-8508-45c0-a796-12e1dc5d46f2 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:23.590553 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ba1357e-8508-45c0-a796-12e1dc5d46f2 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:23.590553 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ba1357e-8508-45c0-a796-12e1dc5d46f2 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:23.590553 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1ba1357e-8508-45c0-a796-12e1dc5d46f2 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:23.810915 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-1ba1357e-8508-45c0-a796-12e1dc5d46f2 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:23.818868 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1ba1357e-8508-45c0-a796-12e1dc5d46f2 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9" status: 200 len: 1319 microversion: 2.1 time: 0.243717 Feb 21 01:43:23.819430 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 511/1033] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:23 2022] GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:24.027453 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-2809e3bc-0ae0-4055-bf20-3933761843f5 req-d333a181-d384-476e-9c8d-6d33f6e20517 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f462aba2-e204-42e0-8f1a-cc25b075bdb9", "tag": "e7fdbbe1-c0e9-4818-b2de-cc2579613ccf"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:43:24.029028 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:43:24.029028 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:43:24.037137 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2809e3bc-0ae0-4055-bf20-3933761843f5 req-d333a181-d384-476e-9c8d-6d33f6e20517 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:24.037583 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-2809e3bc-0ae0-4055-bf20-3933761843f5 req-d333a181-d384-476e-9c8d-6d33f6e20517 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:24.048562 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-2809e3bc-0ae0-4055-bf20-3933761843f5 req-d333a181-d384-476e-9c8d-6d33f6e20517 service nova] Creating event network-changed:e7fdbbe1-c0e9-4818-b2de-cc2579613ccf for instance f462aba2-e204-42e0-8f1a-cc25b075bdb9 on hv-cinder-81322 Feb 21 01:43:24.053623 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-2809e3bc-0ae0-4055-bf20-3933761843f5 req-d333a181-d384-476e-9c8d-6d33f6e20517 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029704 Feb 21 01:43:24.054420 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 523/1034] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:43:24.835811 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-976c0315-8159-47c6-b370-997c80e60db2 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:24.836478 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-976c0315-8159-47c6-b370-997c80e60db2 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: f462aba2-e204-42e0-8f1a-cc25b075bdb9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:24.843548 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-976c0315-8159-47c6-b370-997c80e60db2 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:24.844028 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-976c0315-8159-47c6-b370-997c80e60db2 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:24.844860 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-976c0315-8159-47c6-b370-997c80e60db2 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:24.845302 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-976c0315-8159-47c6-b370-997c80e60db2 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:24.988626 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-976c0315-8159-47c6-b370-997c80e60db2 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:25.001278 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-976c0315-8159-47c6-b370-997c80e60db2 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9" status: 200 len: 1319 microversion: 2.1 time: 0.168649 Feb 21 01:43:25.002318 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 512/1035] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:24 2022] GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:26.021139 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-59e782ab-d557-4885-83dc-9325278660cb tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:26.023395 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-59e782ab-d557-4885-83dc-9325278660cb tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: f462aba2-e204-42e0-8f1a-cc25b075bdb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:26.034314 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59e782ab-d557-4885-83dc-9325278660cb tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:26.034787 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59e782ab-d557-4885-83dc-9325278660cb tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:26.035561 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59e782ab-d557-4885-83dc-9325278660cb tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:26.036017 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-59e782ab-d557-4885-83dc-9325278660cb tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:26.165758 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-59e782ab-d557-4885-83dc-9325278660cb tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:26.173415 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-59e782ab-d557-4885-83dc-9325278660cb tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9" status: 200 len: 1319 microversion: 2.1 time: 0.156967 Feb 21 01:43:26.173972 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 524/1036] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:26 2022] GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:27.190704 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5fd771f4-9fc8-4d9f-b8d5-1b7145929457 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:27.191329 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5fd771f4-9fc8-4d9f-b8d5-1b7145929457 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: f462aba2-e204-42e0-8f1a-cc25b075bdb9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:27.197648 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5fd771f4-9fc8-4d9f-b8d5-1b7145929457 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:27.198098 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5fd771f4-9fc8-4d9f-b8d5-1b7145929457 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:27.198875 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5fd771f4-9fc8-4d9f-b8d5-1b7145929457 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:27.199314 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5fd771f4-9fc8-4d9f-b8d5-1b7145929457 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:27.338859 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-5fd771f4-9fc8-4d9f-b8d5-1b7145929457 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:27.346278 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5fd771f4-9fc8-4d9f-b8d5-1b7145929457 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9" status: 200 len: 1319 microversion: 2.1 time: 0.159302 Feb 21 01:43:27.346848 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 513/1037] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:27 2022] GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:28.362397 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-261f85fc-0571-4357-a43b-0d8cff7a32f3 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:28.363040 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-261f85fc-0571-4357-a43b-0d8cff7a32f3 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: f462aba2-e204-42e0-8f1a-cc25b075bdb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:28.369246 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-261f85fc-0571-4357-a43b-0d8cff7a32f3 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:28.369698 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-261f85fc-0571-4357-a43b-0d8cff7a32f3 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:28.370470 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-261f85fc-0571-4357-a43b-0d8cff7a32f3 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:28.370906 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-261f85fc-0571-4357-a43b-0d8cff7a32f3 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:28.504603 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-261f85fc-0571-4357-a43b-0d8cff7a32f3 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:28.512511 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-261f85fc-0571-4357-a43b-0d8cff7a32f3 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9" status: 200 len: 1319 microversion: 2.1 time: 0.153791 Feb 21 01:43:28.516470 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 525/1038] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:28 2022] GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:29.530126 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-911266af-f9c8-4196-8a32-a687f3dab2b3 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:29.530739 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-911266af-f9c8-4196-8a32-a687f3dab2b3 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: f462aba2-e204-42e0-8f1a-cc25b075bdb9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:29.537231 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-911266af-f9c8-4196-8a32-a687f3dab2b3 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:29.537682 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-911266af-f9c8-4196-8a32-a687f3dab2b3 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:29.538468 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-911266af-f9c8-4196-8a32-a687f3dab2b3 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:29.538901 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-911266af-f9c8-4196-8a32-a687f3dab2b3 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:29.668581 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-911266af-f9c8-4196-8a32-a687f3dab2b3 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:29.678994 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-911266af-f9c8-4196-8a32-a687f3dab2b3 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9" status: 200 len: 1319 microversion: 2.1 time: 0.152929 Feb 21 01:43:29.679573 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 514/1039] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:29 2022] GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:30.094756 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-395a3616-b71f-4b9f-86b1-991eeb7d2783 req-eb76b755-a917-4d43-bd8d-1fc2e0a8197e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f462aba2-e204-42e0-8f1a-cc25b075bdb9", "name": "network-vif-plugged", "status": "completed", "tag": "e7fdbbe1-c0e9-4818-b2de-cc2579613ccf"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:43:30.096494 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:43:30.096494 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:43:30.103959 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-395a3616-b71f-4b9f-86b1-991eeb7d2783 req-eb76b755-a917-4d43-bd8d-1fc2e0a8197e service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:30.104382 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-395a3616-b71f-4b9f-86b1-991eeb7d2783 req-eb76b755-a917-4d43-bd8d-1fc2e0a8197e service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:30.114710 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-395a3616-b71f-4b9f-86b1-991eeb7d2783 req-eb76b755-a917-4d43-bd8d-1fc2e0a8197e service nova] Creating event network-vif-plugged:e7fdbbe1-c0e9-4818-b2de-cc2579613ccf for instance f462aba2-e204-42e0-8f1a-cc25b075bdb9 on hv-cinder-81322 Feb 21 01:43:30.119572 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-395a3616-b71f-4b9f-86b1-991eeb7d2783 req-eb76b755-a917-4d43-bd8d-1fc2e0a8197e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028507 Feb 21 01:43:30.120137 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 526/1040] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:43:30.696234 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-044c1a5b-f7d8-43b8-8032-5023ebd3d14b tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:30.696867 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-044c1a5b-f7d8-43b8-8032-5023ebd3d14b tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: f462aba2-e204-42e0-8f1a-cc25b075bdb9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:30.703573 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-044c1a5b-f7d8-43b8-8032-5023ebd3d14b tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:30.704094 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-044c1a5b-f7d8-43b8-8032-5023ebd3d14b tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:30.704884 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-044c1a5b-f7d8-43b8-8032-5023ebd3d14b tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:30.705311 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-044c1a5b-f7d8-43b8-8032-5023ebd3d14b tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:30.842522 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-044c1a5b-f7d8-43b8-8032-5023ebd3d14b tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:30.850085 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-044c1a5b-f7d8-43b8-8032-5023ebd3d14b tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9" status: 200 len: 1319 microversion: 2.1 time: 0.157626 Feb 21 01:43:30.850651 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 515/1041] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:30 2022] GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:31.867151 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d0e813ac-c5c6-41d8-a4a2-f05ca3ec455b tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:31.868204 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d0e813ac-c5c6-41d8-a4a2-f05ca3ec455b tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: f462aba2-e204-42e0-8f1a-cc25b075bdb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:31.874207 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0e813ac-c5c6-41d8-a4a2-f05ca3ec455b tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:31.874660 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0e813ac-c5c6-41d8-a4a2-f05ca3ec455b tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:31.875439 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0e813ac-c5c6-41d8-a4a2-f05ca3ec455b tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:31.875877 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0e813ac-c5c6-41d8-a4a2-f05ca3ec455b tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:32.009860 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-d0e813ac-c5c6-41d8-a4a2-f05ca3ec455b tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:32.018101 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d0e813ac-c5c6-41d8-a4a2-f05ca3ec455b tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9" status: 200 len: 1319 microversion: 2.1 time: 0.155388 Feb 21 01:43:32.018658 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 527/1042] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:31 2022] GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:33.034845 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ab4e8bbf-96ac-472b-8907-42f33b68237e tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:33.035467 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ab4e8bbf-96ac-472b-8907-42f33b68237e tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: f462aba2-e204-42e0-8f1a-cc25b075bdb9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:33.041678 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab4e8bbf-96ac-472b-8907-42f33b68237e tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:33.042127 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab4e8bbf-96ac-472b-8907-42f33b68237e tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:33.043171 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab4e8bbf-96ac-472b-8907-42f33b68237e tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:33.043614 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ab4e8bbf-96ac-472b-8907-42f33b68237e tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:33.177165 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ab4e8bbf-96ac-472b-8907-42f33b68237e tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:33.184753 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ab4e8bbf-96ac-472b-8907-42f33b68237e tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9" status: 200 len: 1508 microversion: 2.1 time: 0.153579 Feb 21 01:43:33.185317 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 516/1043] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:33 2022] GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:50.737205 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c91e4c10-1b9d-4fdb-a292-9bf86f8fd15f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2068420770", "imageRef": "35936a71-5ec3-4154-b01a-f2dafd8c0364", "flavorRef": "452", "networks": [{"uuid": "0672b0b8-549c-4bc8-8948-2362562e4bc3"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:43:50.786928 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-c91e4c10-1b9d-4fdb-a292-9bf86f8fd15f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] validate_networks() for [('0672b0b8-549c-4bc8-8948-2362562e4bc3', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:43:51.115197 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-c91e4c10-1b9d-4fdb-a292-9bf86f8fd15f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:43:51.115621 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-c91e4c10-1b9d-4fdb-a292-9bf86f8fd15f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:43:51.116088 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-c91e4c10-1b9d-4fdb-a292-9bf86f8fd15f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:43:51.116527 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-c91e4c10-1b9d-4fdb-a292-9bf86f8fd15f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:43:51.116937 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-c91e4c10-1b9d-4fdb-a292-9bf86f8fd15f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:43:51.126678 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c91e4c10-1b9d-4fdb-a292-9bf86f8fd15f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:51.126678 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c91e4c10-1b9d-4fdb-a292-9bf86f8fd15f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:51.127860 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c91e4c10-1b9d-4fdb-a292-9bf86f8fd15f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:51.127860 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c91e4c10-1b9d-4fdb-a292-9bf86f8fd15f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:51.145306 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-c91e4c10-1b9d-4fdb-a292-9bf86f8fd15f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Getting quotas for project 8af4bed604ef4015929214d402588d34. Resources: {'ram', 'cores', 'instances'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:43:51.149117 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-c91e4c10-1b9d-4fdb-a292-9bf86f8fd15f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Getting quotas for user ae83f98e32d34dac973b88b778febaec and project 8af4bed604ef4015929214d402588d34. Resources: {'ram', 'cores', 'instances'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:43:51.159471 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c91e4c10-1b9d-4fdb-a292-9bf86f8fd15f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:43:51.161775 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c91e4c10-1b9d-4fdb-a292-9bf86f8fd15f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35936a71-5ec3-4154-b01a-f2dafd8c0364',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:43:51.306857 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c91e4c10-1b9d-4fdb-a292-9bf86f8fd15f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573191 Feb 21 01:43:51.307410 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 528/1044] 10.222.0.90 () {60 vars in 1146 bytes} [Mon Feb 21 01:43:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:43:51.317835 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-59446d96-b986-49c7-9063-84ed26f8a32b tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:51.318446 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-59446d96-b986-49c7-9063-84ed26f8a32b tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:51.371635 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-59446d96-b986-49c7-9063-84ed26f8a32b tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:51.378706 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-59446d96-b986-49c7-9063-84ed26f8a32b tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810" status: 200 len: 1214 microversion: 2.1 time: 0.064771 Feb 21 01:43:51.384504 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 517/1045] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:51 2022] GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:52.396280 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-85337f93-972a-434c-afbb-814ea24fe016 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:52.396933 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-85337f93-972a-434c-afbb-814ea24fe016 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:52.403375 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85337f93-972a-434c-afbb-814ea24fe016 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:52.403824 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85337f93-972a-434c-afbb-814ea24fe016 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:52.405256 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85337f93-972a-434c-afbb-814ea24fe016 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:52.405696 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-85337f93-972a-434c-afbb-814ea24fe016 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:52.463578 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-85337f93-972a-434c-afbb-814ea24fe016 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:52.471555 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-85337f93-972a-434c-afbb-814ea24fe016 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810" status: 200 len: 1218 microversion: 2.1 time: 0.079894 Feb 21 01:43:52.472117 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 529/1046] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:52 2022] GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:53.488732 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-767a95e1-a2ee-4571-b876-4ef6c28039ef tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:53.489353 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-767a95e1-a2ee-4571-b876-4ef6c28039ef tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:53.495697 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-767a95e1-a2ee-4571-b876-4ef6c28039ef tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:53.496135 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-767a95e1-a2ee-4571-b876-4ef6c28039ef tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:53.496928 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-767a95e1-a2ee-4571-b876-4ef6c28039ef tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:53.497355 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-767a95e1-a2ee-4571-b876-4ef6c28039ef tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:53.564886 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-767a95e1-a2ee-4571-b876-4ef6c28039ef tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:53.575016 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-767a95e1-a2ee-4571-b876-4ef6c28039ef tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810" status: 200 len: 1284 microversion: 2.1 time: 0.086997 Feb 21 01:43:53.575016 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 518/1047] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:53 2022] GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:54.588738 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e5dc4709-6bbb-4f36-941b-2e20e79ad081 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:54.589357 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e5dc4709-6bbb-4f36-941b-2e20e79ad081 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:54.595548 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5dc4709-6bbb-4f36-941b-2e20e79ad081 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:54.595997 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5dc4709-6bbb-4f36-941b-2e20e79ad081 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:54.596801 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5dc4709-6bbb-4f36-941b-2e20e79ad081 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:54.597240 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e5dc4709-6bbb-4f36-941b-2e20e79ad081 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:54.780136 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-e5dc4709-6bbb-4f36-941b-2e20e79ad081 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:54.787284 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e5dc4709-6bbb-4f36-941b-2e20e79ad081 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810" status: 200 len: 1314 microversion: 2.1 time: 0.202195 Feb 21 01:43:54.787850 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 530/1048] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:54 2022] GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:54.843844 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-c729608a-a4e0-45d4-8a74-f9f4a77e7704 req-d8b67dc0-04b1-4f74-8595-dee86b0be95a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94a9bb6d-3c31-4e8b-9fa0-3937f38a6810", "tag": "deb67d0d-1382-45c6-a7ca-5a2009d7e0ab"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:43:54.845620 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:43:54.845620 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:43:54.852394 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c729608a-a4e0-45d4-8a74-f9f4a77e7704 req-d8b67dc0-04b1-4f74-8595-dee86b0be95a service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:54.852865 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-c729608a-a4e0-45d4-8a74-f9f4a77e7704 req-d8b67dc0-04b1-4f74-8595-dee86b0be95a service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:54.864161 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-c729608a-a4e0-45d4-8a74-f9f4a77e7704 req-d8b67dc0-04b1-4f74-8595-dee86b0be95a service nova] Creating event network-changed:deb67d0d-1382-45c6-a7ca-5a2009d7e0ab for instance 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 on hv-cinder-81322 Feb 21 01:43:54.868958 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-c729608a-a4e0-45d4-8a74-f9f4a77e7704 req-d8b67dc0-04b1-4f74-8595-dee86b0be95a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036338 Feb 21 01:43:54.869536 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 519/1049] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:43:55.804540 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-00addbe3-0c9c-4f88-85e8-e5ee730b614f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:55.805155 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-00addbe3-0c9c-4f88-85e8-e5ee730b614f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:55.811892 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-00addbe3-0c9c-4f88-85e8-e5ee730b614f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:55.812344 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-00addbe3-0c9c-4f88-85e8-e5ee730b614f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:55.813139 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-00addbe3-0c9c-4f88-85e8-e5ee730b614f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:55.813575 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-00addbe3-0c9c-4f88-85e8-e5ee730b614f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:55.944198 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-00addbe3-0c9c-4f88-85e8-e5ee730b614f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:55.951464 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-00addbe3-0c9c-4f88-85e8-e5ee730b614f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810" status: 200 len: 1314 microversion: 2.1 time: 0.150679 Feb 21 01:43:55.952019 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 531/1050] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:55 2022] GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:56.969510 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c6975247-4468-4065-86a8-8f6fee9c2f31 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:56.970219 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c6975247-4468-4065-86a8-8f6fee9c2f31 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:56.976238 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6975247-4468-4065-86a8-8f6fee9c2f31 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:56.976711 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6975247-4468-4065-86a8-8f6fee9c2f31 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:56.977491 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6975247-4468-4065-86a8-8f6fee9c2f31 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:56.977926 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c6975247-4468-4065-86a8-8f6fee9c2f31 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:57.112461 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c6975247-4468-4065-86a8-8f6fee9c2f31 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:57.121788 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c6975247-4468-4065-86a8-8f6fee9c2f31 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810" status: 200 len: 1314 microversion: 2.1 time: 0.157096 Feb 21 01:43:57.122523 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 520/1051] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:56 2022] GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:58.139912 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8d112a60-d530-43d7-9272-87d254443dcd tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:58.140538 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8d112a60-d530-43d7-9272-87d254443dcd tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:58.149465 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d112a60-d530-43d7-9272-87d254443dcd tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:58.150259 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d112a60-d530-43d7-9272-87d254443dcd tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:58.151595 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d112a60-d530-43d7-9272-87d254443dcd tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:58.152083 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8d112a60-d530-43d7-9272-87d254443dcd tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:58.299438 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-8d112a60-d530-43d7-9272-87d254443dcd tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:58.307575 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8d112a60-d530-43d7-9272-87d254443dcd tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810" status: 200 len: 1314 microversion: 2.1 time: 0.172029 Feb 21 01:43:58.308142 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 532/1052] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:58 2022] GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:43:59.032854 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-060564de-516f-4b62-85f6-c9e13d48e248 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35a1d59f-6374-4667-93b3-d84704d70e80", "device": "/dev/sdb"}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:43:59.034471 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-060564de-516f-4b62-85f6-c9e13d48e248 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: f462aba2-e204-42e0-8f1a-cc25b075bdb9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:59.040869 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-060564de-516f-4b62-85f6-c9e13d48e248 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:59.041328 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-060564de-516f-4b62-85f6-c9e13d48e248 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:59.042104 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-060564de-516f-4b62-85f6-c9e13d48e248 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:59.042538 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-060564de-516f-4b62-85f6-c9e13d48e248 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:59.323907 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-fd7347f4-ff2a-4ceb-b914-9fb9ec244dcb tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:43:59.324722 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-fd7347f4-ff2a-4ceb-b914-9fb9ec244dcb tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:43:59.330917 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd7347f4-ff2a-4ceb-b914-9fb9ec244dcb tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:59.331361 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd7347f4-ff2a-4ceb-b914-9fb9ec244dcb tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:59.332129 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd7347f4-ff2a-4ceb-b914-9fb9ec244dcb tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:43:59.332598 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-fd7347f4-ff2a-4ceb-b914-9fb9ec244dcb tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:43:59.722019 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-060564de-516f-4b62-85f6-c9e13d48e248 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "POST /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.693016 Feb 21 01:43:59.723387 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 521/1053] 10.222.0.90 () {60 vars in 1322 bytes} [Mon Feb 21 01:43:59 2022] POST /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9/os-volume_attachments => generated 194 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:43:59.723546 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-fd7347f4-ff2a-4ceb-b914-9fb9ec244dcb tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:43:59.730473 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-fd7347f4-ff2a-4ceb-b914-9fb9ec244dcb tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810" status: 200 len: 1314 microversion: 2.1 time: 0.410099 Feb 21 01:43:59.739612 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 533/1054] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:43:59 2022] GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:44:00.746925 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-56afe152-ef93-4b3f-b9d5-50870e62b92f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:00.747583 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-56afe152-ef93-4b3f-b9d5-50870e62b92f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:00.754103 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56afe152-ef93-4b3f-b9d5-50870e62b92f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:00.754546 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56afe152-ef93-4b3f-b9d5-50870e62b92f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:00.755319 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56afe152-ef93-4b3f-b9d5-50870e62b92f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:00.755748 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-56afe152-ef93-4b3f-b9d5-50870e62b92f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:00.896031 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-56afe152-ef93-4b3f-b9d5-50870e62b92f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:00.904390 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-56afe152-ef93-4b3f-b9d5-50870e62b92f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810" status: 200 len: 1314 microversion: 2.1 time: 0.161017 Feb 21 01:44:00.904992 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 522/1055] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:00 2022] GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:01.920705 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d48ffb22-8447-4eca-84d1-b839637f0f06 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:01.921318 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d48ffb22-8447-4eca-84d1-b839637f0f06 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:01.927503 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d48ffb22-8447-4eca-84d1-b839637f0f06 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:01.927951 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d48ffb22-8447-4eca-84d1-b839637f0f06 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:01.928753 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d48ffb22-8447-4eca-84d1-b839637f0f06 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:01.929187 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d48ffb22-8447-4eca-84d1-b839637f0f06 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:02.059353 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-d48ffb22-8447-4eca-84d1-b839637f0f06 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:02.067002 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d48ffb22-8447-4eca-84d1-b839637f0f06 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810" status: 200 len: 1314 microversion: 2.1 time: 0.150558 Feb 21 01:44:02.067565 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 534/1056] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:01 2022] GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:02.352281 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-de437648-a372-4afe-9d51-ea705385266a req-99dca2c7-91b7-4d54-b8a9-f45652019519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a9bb6d-3c31-4e8b-9fa0-3937f38a6810", "name": "network-vif-plugged", "status": "completed", "tag": "deb67d0d-1382-45c6-a7ca-5a2009d7e0ab"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:44:02.353873 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:44:02.353873 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:44:02.361809 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-de437648-a372-4afe-9d51-ea705385266a req-99dca2c7-91b7-4d54-b8a9-f45652019519 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:02.362259 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-de437648-a372-4afe-9d51-ea705385266a req-99dca2c7-91b7-4d54-b8a9-f45652019519 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:02.375310 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-de437648-a372-4afe-9d51-ea705385266a req-99dca2c7-91b7-4d54-b8a9-f45652019519 service nova] Creating event network-vif-plugged:deb67d0d-1382-45c6-a7ca-5a2009d7e0ab for instance 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 on hv-cinder-81322 Feb 21 01:44:02.380397 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-de437648-a372-4afe-9d51-ea705385266a req-99dca2c7-91b7-4d54-b8a9-f45652019519 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031963 Feb 21 01:44:02.381446 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 523/1057] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:44:03.083133 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-281ece37-2fe5-4bf5-86f4-ba1fd189ca14 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:03.083776 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-281ece37-2fe5-4bf5-86f4-ba1fd189ca14 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:03.089971 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-281ece37-2fe5-4bf5-86f4-ba1fd189ca14 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:03.090423 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-281ece37-2fe5-4bf5-86f4-ba1fd189ca14 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:03.091205 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-281ece37-2fe5-4bf5-86f4-ba1fd189ca14 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:03.091645 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-281ece37-2fe5-4bf5-86f4-ba1fd189ca14 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:03.221854 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-281ece37-2fe5-4bf5-86f4-ba1fd189ca14 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:03.228969 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-281ece37-2fe5-4bf5-86f4-ba1fd189ca14 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810" status: 200 len: 1314 microversion: 2.1 time: 0.149590 Feb 21 01:44:03.229524 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 535/1058] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:03 2022] GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:04.245319 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-361c889f-9d25-484d-8293-b4e33f245181 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:04.245993 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-361c889f-9d25-484d-8293-b4e33f245181 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:04.252666 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-361c889f-9d25-484d-8293-b4e33f245181 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:04.253111 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-361c889f-9d25-484d-8293-b4e33f245181 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:04.253894 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-361c889f-9d25-484d-8293-b4e33f245181 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:04.254324 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-361c889f-9d25-484d-8293-b4e33f245181 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:04.394166 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-361c889f-9d25-484d-8293-b4e33f245181 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:04.401418 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-361c889f-9d25-484d-8293-b4e33f245181 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810" status: 200 len: 1314 microversion: 2.1 time: 0.160278 Feb 21 01:44:04.405963 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 524/1059] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:04 2022] GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:05.418652 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-23df2fcd-af09-4d78-9e11-d918eb9361b8 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:05.419254 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-23df2fcd-af09-4d78-9e11-d918eb9361b8 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:05.426114 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23df2fcd-af09-4d78-9e11-d918eb9361b8 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:05.426558 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23df2fcd-af09-4d78-9e11-d918eb9361b8 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:05.427319 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23df2fcd-af09-4d78-9e11-d918eb9361b8 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:05.427745 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-23df2fcd-af09-4d78-9e11-d918eb9361b8 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:05.555489 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-23df2fcd-af09-4d78-9e11-d918eb9361b8 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:05.562640 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-23df2fcd-af09-4d78-9e11-d918eb9361b8 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810" status: 200 len: 1498 microversion: 2.1 time: 0.147657 Feb 21 01:44:05.563200 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 536/1060] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:05 2022] GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 => generated 1498 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:06.500098 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-917885d8-1c5e-4a4f-8c39-49e384fd149e tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:06.500690 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-917885d8-1c5e-4a4f-8c39-49e384fd149e tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:06.506929 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-917885d8-1c5e-4a4f-8c39-49e384fd149e tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:06.507378 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-917885d8-1c5e-4a4f-8c39-49e384fd149e tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:06.508157 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-917885d8-1c5e-4a4f-8c39-49e384fd149e tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:06.508630 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-917885d8-1c5e-4a4f-8c39-49e384fd149e tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:06.532961 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-917885d8-1c5e-4a4f-8c39-49e384fd149e tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:44:06.820683 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-917885d8-1c5e-4a4f-8c39-49e384fd149e tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "DELETE /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810" status: 204 len: 0 microversion: 2.1 time: 0.324449 Feb 21 01:44:06.821268 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 525/1061] 10.222.0.90 () {58 vars in 1238 bytes} [Mon Feb 21 01:44:06 2022] DELETE /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 21 01:44:06.829300 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a8835dc0-254c-4c2a-bd38-56fe587669ff tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:06.829936 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a8835dc0-254c-4c2a-bd38-56fe587669ff tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:06.836136 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8835dc0-254c-4c2a-bd38-56fe587669ff tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:06.836635 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8835dc0-254c-4c2a-bd38-56fe587669ff tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:06.837393 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8835dc0-254c-4c2a-bd38-56fe587669ff tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:06.837817 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a8835dc0-254c-4c2a-bd38-56fe587669ff tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:06.973056 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-a8835dc0-254c-4c2a-bd38-56fe587669ff tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:06.980210 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a8835dc0-254c-4c2a-bd38-56fe587669ff tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810" status: 200 len: 1504 microversion: 2.1 time: 0.154721 Feb 21 01:44:06.980804 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 537/1062] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:06 2022] GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:08.001766 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-54b5817d-ab39-42f1-9386-999db57a5164 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:08.002429 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-54b5817d-ab39-42f1-9386-999db57a5164 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:08.008742 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54b5817d-ab39-42f1-9386-999db57a5164 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:08.009191 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54b5817d-ab39-42f1-9386-999db57a5164 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:08.009959 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54b5817d-ab39-42f1-9386-999db57a5164 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:08.010391 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-54b5817d-ab39-42f1-9386-999db57a5164 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:08.140974 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-54b5817d-ab39-42f1-9386-999db57a5164 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:08.148096 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-54b5817d-ab39-42f1-9386-999db57a5164 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810" status: 200 len: 1504 microversion: 2.1 time: 0.151139 Feb 21 01:44:08.148694 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 526/1063] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:07 2022] GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:09.165141 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1694e7fe-6349-4841-905f-a8adcc02be44 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:09.165746 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1694e7fe-6349-4841-905f-a8adcc02be44 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:09.171416 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1694e7fe-6349-4841-905f-a8adcc02be44 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:09.171861 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1694e7fe-6349-4841-905f-a8adcc02be44 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:09.172672 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1694e7fe-6349-4841-905f-a8adcc02be44 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:09.173099 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1694e7fe-6349-4841-905f-a8adcc02be44 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:09.305819 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1694e7fe-6349-4841-905f-a8adcc02be44 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:09.313606 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1694e7fe-6349-4841-905f-a8adcc02be44 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810" status: 200 len: 1504 microversion: 2.1 time: 0.152302 Feb 21 01:44:09.314161 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 538/1064] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:09 2022] GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:10.330825 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-25f3ae04-99c2-4d73-ace8-74f2b6035ee4 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:10.331442 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-25f3ae04-99c2-4d73-ace8-74f2b6035ee4 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:10.337761 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25f3ae04-99c2-4d73-ace8-74f2b6035ee4 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:10.338213 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25f3ae04-99c2-4d73-ace8-74f2b6035ee4 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:10.338985 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25f3ae04-99c2-4d73-ace8-74f2b6035ee4 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:10.339418 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-25f3ae04-99c2-4d73-ace8-74f2b6035ee4 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:10.473657 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-25f3ae04-99c2-4d73-ace8-74f2b6035ee4 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:10.480907 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-25f3ae04-99c2-4d73-ace8-74f2b6035ee4 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810" status: 200 len: 1504 microversion: 2.1 time: 0.154228 Feb 21 01:44:10.486948 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 527/1065] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:10 2022] GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:11.497642 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5ee096dd-4bfa-40b4-ad3a-dc52e7f2daf9 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:11.498232 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5ee096dd-4bfa-40b4-ad3a-dc52e7f2daf9 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:11.504646 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ee096dd-4bfa-40b4-ad3a-dc52e7f2daf9 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:11.505091 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ee096dd-4bfa-40b4-ad3a-dc52e7f2daf9 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:11.505852 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ee096dd-4bfa-40b4-ad3a-dc52e7f2daf9 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:11.506280 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5ee096dd-4bfa-40b4-ad3a-dc52e7f2daf9 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:11.646166 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-5ee096dd-4bfa-40b4-ad3a-dc52e7f2daf9 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:11.653616 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5ee096dd-4bfa-40b4-ad3a-dc52e7f2daf9 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810" status: 200 len: 1504 microversion: 2.1 time: 0.159581 Feb 21 01:44:11.654182 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 539/1066] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:11 2022] GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:12.461692 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-47eb33c1-7002-403e-a654-96244ae41df3 req-aacc4425-45f4-48af-a91d-acef218d4368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a9bb6d-3c31-4e8b-9fa0-3937f38a6810", "name": "network-vif-deleted", "tag": "deb67d0d-1382-45c6-a7ca-5a2009d7e0ab"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:44:12.463327 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:44:12.463327 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:44:12.470548 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-47eb33c1-7002-403e-a654-96244ae41df3 req-aacc4425-45f4-48af-a91d-acef218d4368 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:12.471016 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-47eb33c1-7002-403e-a654-96244ae41df3 req-aacc4425-45f4-48af-a91d-acef218d4368 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:12.481802 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-47eb33c1-7002-403e-a654-96244ae41df3 req-aacc4425-45f4-48af-a91d-acef218d4368 service nova] Creating event network-vif-deleted:deb67d0d-1382-45c6-a7ca-5a2009d7e0ab for instance 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 on hv-cinder-81322 Feb 21 01:44:12.487086 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-47eb33c1-7002-403e-a654-96244ae41df3 req-aacc4425-45f4-48af-a91d-acef218d4368 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029015 Feb 21 01:44:12.487687 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 528/1067] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:44:12.672408 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-0cea4b99-4a17-464d-b643-f2a56c06a2fe tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:12.673864 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-0cea4b99-4a17-464d-b643-f2a56c06a2fe tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:12.680131 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0cea4b99-4a17-464d-b643-f2a56c06a2fe tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:12.680727 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0cea4b99-4a17-464d-b643-f2a56c06a2fe tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:12.681506 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0cea4b99-4a17-464d-b643-f2a56c06a2fe tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:12.681939 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0cea4b99-4a17-464d-b643-f2a56c06a2fe tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:12.712542 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0cea4b99-4a17-464d-b643-f2a56c06a2fe tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:12.712990 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-0cea4b99-4a17-464d-b643-f2a56c06a2fe tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:12.713432 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-0cea4b99-4a17-464d-b643-f2a56c06a2fe tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lazy-loading 'fault' on Instance uuid 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:44:12.752480 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-0cea4b99-4a17-464d-b643-f2a56c06a2fe tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:12.759912 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-0cea4b99-4a17-464d-b643-f2a56c06a2fe tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810" status: 200 len: 1304 microversion: 2.1 time: 0.092423 Feb 21 01:44:12.762578 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 540/1068] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:12 2022] GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:13.778107 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cea540db-86d3-4fac-85bf-a6515a20767d tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:13.778814 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cea540db-86d3-4fac-85bf-a6515a20767d tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:13.784819 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cea540db-86d3-4fac-85bf-a6515a20767d tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:13.790814 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cea540db-86d3-4fac-85bf-a6515a20767d tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:13.790814 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cea540db-86d3-4fac-85bf-a6515a20767d tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:13.790814 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-cea540db-86d3-4fac-85bf-a6515a20767d tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:13.799630 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-cea540db-86d3-4fac-85bf-a6515a20767d tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] HTTP exception thrown: Instance 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 could not be found. Feb 21 01:44:13.800218 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cea540db-86d3-4fac-85bf-a6515a20767d tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Returning 404 to user: Instance 94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:44:13.801064 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cea540db-86d3-4fac-85bf-a6515a20767d tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810" status: 404 len: 111 microversion: 2.1 time: 0.027474 Feb 21 01:44:13.801781 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 529/1069] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:13 2022] GET /compute/v2.1/servers/94a9bb6d-3c31-4e8b-9fa0-3937f38a6810 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:44:13.847628 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-76bacbf2-772a-4279-8759-3ab3a73c0c93 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1325767758", "imageRef": "35936a71-5ec3-4154-b01a-f2dafd8c0364", "flavorRef": "452", "networks": [{"uuid": "0672b0b8-549c-4bc8-8948-2362562e4bc3"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:44:13.895972 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-76bacbf2-772a-4279-8759-3ab3a73c0c93 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] validate_networks() for [('0672b0b8-549c-4bc8-8948-2362562e4bc3', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:44:14.225003 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-76bacbf2-772a-4279-8759-3ab3a73c0c93 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:44:14.225430 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-76bacbf2-772a-4279-8759-3ab3a73c0c93 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:44:14.225903 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-76bacbf2-772a-4279-8759-3ab3a73c0c93 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:44:14.226312 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-76bacbf2-772a-4279-8759-3ab3a73c0c93 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:44:14.226751 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-76bacbf2-772a-4279-8759-3ab3a73c0c93 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:44:14.235623 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76bacbf2-772a-4279-8759-3ab3a73c0c93 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:14.236099 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76bacbf2-772a-4279-8759-3ab3a73c0c93 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:14.236949 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76bacbf2-772a-4279-8759-3ab3a73c0c93 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:14.237393 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-76bacbf2-772a-4279-8759-3ab3a73c0c93 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:14.253181 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-76bacbf2-772a-4279-8759-3ab3a73c0c93 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Getting quotas for project 8af4bed604ef4015929214d402588d34. Resources: {'ram', 'cores', 'instances'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:44:14.256843 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-76bacbf2-772a-4279-8759-3ab3a73c0c93 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Getting quotas for user ae83f98e32d34dac973b88b778febaec and project 8af4bed604ef4015929214d402588d34. Resources: {'ram', 'cores', 'instances'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:44:14.267420 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-76bacbf2-772a-4279-8759-3ab3a73c0c93 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:44:14.269570 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-76bacbf2-772a-4279-8759-3ab3a73c0c93 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 487ce617-4be7-4cdd-b23e-f2af1636afe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35936a71-5ec3-4154-b01a-f2dafd8c0364',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:44:14.455748 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-76bacbf2-772a-4279-8759-3ab3a73c0c93 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.611689 Feb 21 01:44:14.456312 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 541/1070] 10.222.0.90 () {60 vars in 1146 bytes} [Mon Feb 21 01:44:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:44:14.466237 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-cc5ed5fd-d5a2-4b20-9154-4ddffb297642 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:14.466852 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-cc5ed5fd-d5a2-4b20-9154-4ddffb297642 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 487ce617-4be7-4cdd-b23e-f2af1636afe2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:14.521025 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-cc5ed5fd-d5a2-4b20-9154-4ddffb297642 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:14.527466 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-cc5ed5fd-d5a2-4b20-9154-4ddffb297642 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2" status: 200 len: 1214 microversion: 2.1 time: 0.064964 Feb 21 01:44:14.528063 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 530/1071] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:14 2022] GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:15.544355 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-da76a7be-136c-4982-9e92-580b22babf97 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:15.544997 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-da76a7be-136c-4982-9e92-580b22babf97 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 487ce617-4be7-4cdd-b23e-f2af1636afe2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:15.551557 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da76a7be-136c-4982-9e92-580b22babf97 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:15.552006 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da76a7be-136c-4982-9e92-580b22babf97 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:15.552805 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da76a7be-136c-4982-9e92-580b22babf97 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:15.553247 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-da76a7be-136c-4982-9e92-580b22babf97 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:15.609652 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-da76a7be-136c-4982-9e92-580b22babf97 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:15.616780 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-da76a7be-136c-4982-9e92-580b22babf97 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2" status: 200 len: 1218 microversion: 2.1 time: 0.076608 Feb 21 01:44:15.617342 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 542/1072] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:15 2022] GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2 => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:16.633322 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-a5cd03af-89f6-4709-8a65-33ad2050b103 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:16.633991 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-a5cd03af-89f6-4709-8a65-33ad2050b103 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 487ce617-4be7-4cdd-b23e-f2af1636afe2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:16.643518 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5cd03af-89f6-4709-8a65-33ad2050b103 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:16.643967 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5cd03af-89f6-4709-8a65-33ad2050b103 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:16.644761 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5cd03af-89f6-4709-8a65-33ad2050b103 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:16.645189 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-a5cd03af-89f6-4709-8a65-33ad2050b103 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:16.701783 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-a5cd03af-89f6-4709-8a65-33ad2050b103 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:16.708869 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-a5cd03af-89f6-4709-8a65-33ad2050b103 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2" status: 200 len: 1218 microversion: 2.1 time: 0.079171 Feb 21 01:44:16.709418 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 531/1073] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:16 2022] GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:44:17.725518 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2a0d4deb-f9df-4b70-bcea-53614dc6f8ba tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:17.726126 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2a0d4deb-f9df-4b70-bcea-53614dc6f8ba tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 487ce617-4be7-4cdd-b23e-f2af1636afe2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:17.732328 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a0d4deb-f9df-4b70-bcea-53614dc6f8ba tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:17.732800 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a0d4deb-f9df-4b70-bcea-53614dc6f8ba tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:17.734075 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a0d4deb-f9df-4b70-bcea-53614dc6f8ba tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:17.734530 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2a0d4deb-f9df-4b70-bcea-53614dc6f8ba tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:17.796292 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2a0d4deb-f9df-4b70-bcea-53614dc6f8ba tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:17.803562 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2a0d4deb-f9df-4b70-bcea-53614dc6f8ba tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2" status: 200 len: 1266 microversion: 2.1 time: 0.081673 Feb 21 01:44:17.804152 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 543/1074] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:17 2022] GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:18.821040 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-bd177c0c-1d8e-458d-b8ba-39d3e6b6aa00 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:18.821644 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-bd177c0c-1d8e-458d-b8ba-39d3e6b6aa00 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 487ce617-4be7-4cdd-b23e-f2af1636afe2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:18.828445 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd177c0c-1d8e-458d-b8ba-39d3e6b6aa00 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:18.828982 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd177c0c-1d8e-458d-b8ba-39d3e6b6aa00 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:18.829762 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd177c0c-1d8e-458d-b8ba-39d3e6b6aa00 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:18.830282 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-bd177c0c-1d8e-458d-b8ba-39d3e6b6aa00 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:18.893765 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-bd177c0c-1d8e-458d-b8ba-39d3e6b6aa00 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:18.900980 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-bd177c0c-1d8e-458d-b8ba-39d3e6b6aa00 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2" status: 200 len: 1272 microversion: 2.1 time: 0.083714 Feb 21 01:44:18.903829 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 532/1075] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:18 2022] GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2 => generated 1272 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:19.917791 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-baa6b43b-5a8f-4597-b2d5-d642831ba17b tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:19.918368 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-baa6b43b-5a8f-4597-b2d5-d642831ba17b tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 487ce617-4be7-4cdd-b23e-f2af1636afe2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:19.924618 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-baa6b43b-5a8f-4597-b2d5-d642831ba17b tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:19.925063 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-baa6b43b-5a8f-4597-b2d5-d642831ba17b tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:19.925832 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-baa6b43b-5a8f-4597-b2d5-d642831ba17b tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:19.926265 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-baa6b43b-5a8f-4597-b2d5-d642831ba17b tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:20.066455 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-baa6b43b-5a8f-4597-b2d5-d642831ba17b tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:20.073576 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-baa6b43b-5a8f-4597-b2d5-d642831ba17b tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2" status: 200 len: 1314 microversion: 2.1 time: 0.159480 Feb 21 01:44:20.074146 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 544/1076] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:19 2022] GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:21.090949 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7131571b-de35-4a89-b877-c3a698c3ba02 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:21.091577 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7131571b-de35-4a89-b877-c3a698c3ba02 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 487ce617-4be7-4cdd-b23e-f2af1636afe2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:21.098812 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7131571b-de35-4a89-b877-c3a698c3ba02 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:21.099259 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7131571b-de35-4a89-b877-c3a698c3ba02 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:21.100033 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7131571b-de35-4a89-b877-c3a698c3ba02 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:21.100501 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7131571b-de35-4a89-b877-c3a698c3ba02 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:21.172328 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-da290be2-4816-443f-8fb9-9c2d91e35ffd req-741f7483-c911-4223-a722-420563339c69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "487ce617-4be7-4cdd-b23e-f2af1636afe2", "tag": "9ea3d121-7900-4996-b64b-7306ffc721b9"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:44:21.174064 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:44:21.174064 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:44:21.183250 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-da290be2-4816-443f-8fb9-9c2d91e35ffd req-741f7483-c911-4223-a722-420563339c69 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:21.183803 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-da290be2-4816-443f-8fb9-9c2d91e35ffd req-741f7483-c911-4223-a722-420563339c69 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:21.194800 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-da290be2-4816-443f-8fb9-9c2d91e35ffd req-741f7483-c911-4223-a722-420563339c69 service nova] Creating event network-changed:9ea3d121-7900-4996-b64b-7306ffc721b9 for instance 487ce617-4be7-4cdd-b23e-f2af1636afe2 on hv-cinder-81322 Feb 21 01:44:21.201756 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-da290be2-4816-443f-8fb9-9c2d91e35ffd req-741f7483-c911-4223-a722-420563339c69 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031720 Feb 21 01:44:21.201756 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 545/1077] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:44:21.282604 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-7131571b-de35-4a89-b877-c3a698c3ba02 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:21.290037 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7131571b-de35-4a89-b877-c3a698c3ba02 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2" status: 200 len: 1314 microversion: 2.1 time: 0.203054 Feb 21 01:44:21.290538 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 533/1078] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:21 2022] GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:22.307796 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ce9fbfbd-a312-46d6-94f6-1549206e4743 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:22.308505 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ce9fbfbd-a312-46d6-94f6-1549206e4743 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 487ce617-4be7-4cdd-b23e-f2af1636afe2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:22.314493 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce9fbfbd-a312-46d6-94f6-1549206e4743 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:22.319346 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce9fbfbd-a312-46d6-94f6-1549206e4743 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:22.319346 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce9fbfbd-a312-46d6-94f6-1549206e4743 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:22.319346 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce9fbfbd-a312-46d6-94f6-1549206e4743 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:22.443954 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-ce9fbfbd-a312-46d6-94f6-1549206e4743 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:22.451104 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ce9fbfbd-a312-46d6-94f6-1549206e4743 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2" status: 200 len: 1314 microversion: 2.1 time: 0.147791 Feb 21 01:44:22.452169 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 546/1079] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:22 2022] GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:23.468290 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fe31ad3a-6733-42bc-acf2-e85872ad3739 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:23.468937 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fe31ad3a-6733-42bc-acf2-e85872ad3739 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 487ce617-4be7-4cdd-b23e-f2af1636afe2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:23.475340 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe31ad3a-6733-42bc-acf2-e85872ad3739 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:23.475813 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe31ad3a-6733-42bc-acf2-e85872ad3739 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:23.476620 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe31ad3a-6733-42bc-acf2-e85872ad3739 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:23.477075 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-fe31ad3a-6733-42bc-acf2-e85872ad3739 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:23.698000 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-fe31ad3a-6733-42bc-acf2-e85872ad3739 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:23.706007 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fe31ad3a-6733-42bc-acf2-e85872ad3739 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2" status: 200 len: 1314 microversion: 2.1 time: 0.242008 Feb 21 01:44:23.706678 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 534/1080] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:23 2022] GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:24.722746 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-60124f04-d706-4bfa-acd2-f129f9c0ca87 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:24.723359 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-60124f04-d706-4bfa-acd2-f129f9c0ca87 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 487ce617-4be7-4cdd-b23e-f2af1636afe2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:24.729841 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60124f04-d706-4bfa-acd2-f129f9c0ca87 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:24.730285 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60124f04-d706-4bfa-acd2-f129f9c0ca87 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:24.731079 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60124f04-d706-4bfa-acd2-f129f9c0ca87 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:24.731507 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-60124f04-d706-4bfa-acd2-f129f9c0ca87 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:24.868108 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-60124f04-d706-4bfa-acd2-f129f9c0ca87 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:24.875188 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-60124f04-d706-4bfa-acd2-f129f9c0ca87 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2" status: 200 len: 1314 microversion: 2.1 time: 0.156098 Feb 21 01:44:24.875746 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 547/1081] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:24 2022] GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:25.891826 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-81787444-5fde-4e20-b0db-fc47d9799307 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:25.892375 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-81787444-5fde-4e20-b0db-fc47d9799307 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 487ce617-4be7-4cdd-b23e-f2af1636afe2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:25.898635 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81787444-5fde-4e20-b0db-fc47d9799307 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:25.899115 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81787444-5fde-4e20-b0db-fc47d9799307 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:25.899896 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81787444-5fde-4e20-b0db-fc47d9799307 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:25.900330 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81787444-5fde-4e20-b0db-fc47d9799307 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:26.029282 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-81787444-5fde-4e20-b0db-fc47d9799307 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:26.038411 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-81787444-5fde-4e20-b0db-fc47d9799307 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2" status: 200 len: 1314 microversion: 2.1 time: 0.149443 Feb 21 01:44:26.038986 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 535/1082] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:25 2022] GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:27.055432 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7fbf85f6-e4d4-4c7b-a98f-d293c1ccabca tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:27.056082 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7fbf85f6-e4d4-4c7b-a98f-d293c1ccabca tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 487ce617-4be7-4cdd-b23e-f2af1636afe2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:27.062892 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7fbf85f6-e4d4-4c7b-a98f-d293c1ccabca tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:27.063334 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7fbf85f6-e4d4-4c7b-a98f-d293c1ccabca tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:27.064097 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7fbf85f6-e4d4-4c7b-a98f-d293c1ccabca tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:27.064617 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7fbf85f6-e4d4-4c7b-a98f-d293c1ccabca tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:27.200395 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-7fbf85f6-e4d4-4c7b-a98f-d293c1ccabca tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:27.208281 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7fbf85f6-e4d4-4c7b-a98f-d293c1ccabca tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2" status: 200 len: 1314 microversion: 2.1 time: 0.156520 Feb 21 01:44:27.208867 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 548/1083] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:27 2022] GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:28.225582 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-77d5e7b6-9ddb-4cce-b5e5-94fd1bca9b84 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:28.226199 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-77d5e7b6-9ddb-4cce-b5e5-94fd1bca9b84 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 487ce617-4be7-4cdd-b23e-f2af1636afe2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:28.232527 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77d5e7b6-9ddb-4cce-b5e5-94fd1bca9b84 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:28.232981 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77d5e7b6-9ddb-4cce-b5e5-94fd1bca9b84 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:28.233756 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77d5e7b6-9ddb-4cce-b5e5-94fd1bca9b84 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:28.234197 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-77d5e7b6-9ddb-4cce-b5e5-94fd1bca9b84 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:28.315361 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-bdd5171a-5c09-4947-ab96-5b53e09b9d15 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:28.315945 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-bdd5171a-5c09-4947-ab96-5b53e09b9d15 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: f462aba2-e204-42e0-8f1a-cc25b075bdb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:28.322308 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bdd5171a-5c09-4947-ab96-5b53e09b9d15 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:28.323856 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bdd5171a-5c09-4947-ab96-5b53e09b9d15 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:28.323856 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bdd5171a-5c09-4947-ab96-5b53e09b9d15 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:28.324061 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-bdd5171a-5c09-4947-ab96-5b53e09b9d15 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:28.364188 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-77d5e7b6-9ddb-4cce-b5e5-94fd1bca9b84 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:28.371677 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-77d5e7b6-9ddb-4cce-b5e5-94fd1bca9b84 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2" status: 200 len: 1314 microversion: 2.1 time: 0.150744 Feb 21 01:44:28.372329 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 536/1084] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:28 2022] GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:28.402956 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-bdd5171a-5c09-4947-ab96-5b53e09b9d15 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lazy-loading 'services' on Instance uuid f462aba2-e204-42e0-8f1a-cc25b075bdb9 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:44:28.578126 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-bdd5171a-5c09-4947-ab96-5b53e09b9d15 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "DELETE /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9/os-volume_attachments/35a1d59f-6374-4667-93b3-d84704d70e80" status: 202 len: 0 microversion: 2.1 time: 0.266683 Feb 21 01:44:28.578711 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 549/1085] 10.222.0.90 () {58 vars in 1415 bytes} [Mon Feb 21 01:44:28 2022] DELETE /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9/os-volume_attachments/35a1d59f-6374-4667-93b3-d84704d70e80 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 21 01:44:29.262906 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-d76f3508-f768-44d8-857a-fde0522be0ce req-ce11c3e6-76b4-4b18-9eb7-fb65f59bb33b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487ce617-4be7-4cdd-b23e-f2af1636afe2", "name": "network-vif-plugged", "status": "completed", "tag": "9ea3d121-7900-4996-b64b-7306ffc721b9"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:44:29.265113 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:44:29.265113 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:44:29.271798 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d76f3508-f768-44d8-857a-fde0522be0ce req-ce11c3e6-76b4-4b18-9eb7-fb65f59bb33b service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:29.274826 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-d76f3508-f768-44d8-857a-fde0522be0ce req-ce11c3e6-76b4-4b18-9eb7-fb65f59bb33b service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:29.284713 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-d76f3508-f768-44d8-857a-fde0522be0ce req-ce11c3e6-76b4-4b18-9eb7-fb65f59bb33b service nova] Creating event network-vif-plugged:9ea3d121-7900-4996-b64b-7306ffc721b9 for instance 487ce617-4be7-4cdd-b23e-f2af1636afe2 on hv-cinder-81322 Feb 21 01:44:29.289615 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-d76f3508-f768-44d8-857a-fde0522be0ce req-ce11c3e6-76b4-4b18-9eb7-fb65f59bb33b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203974 Feb 21 01:44:29.290192 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 537/1086] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:44:29.389640 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-40b9e241-7d8b-4bf0-8cb6-f20b147f4705 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:29.390355 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-40b9e241-7d8b-4bf0-8cb6-f20b147f4705 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 487ce617-4be7-4cdd-b23e-f2af1636afe2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:29.397049 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40b9e241-7d8b-4bf0-8cb6-f20b147f4705 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:29.397498 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40b9e241-7d8b-4bf0-8cb6-f20b147f4705 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:29.399886 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40b9e241-7d8b-4bf0-8cb6-f20b147f4705 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:29.399886 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-40b9e241-7d8b-4bf0-8cb6-f20b147f4705 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:29.530402 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-40b9e241-7d8b-4bf0-8cb6-f20b147f4705 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:29.538622 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-40b9e241-7d8b-4bf0-8cb6-f20b147f4705 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2" status: 200 len: 1314 microversion: 2.1 time: 0.153850 Feb 21 01:44:29.539196 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 550/1087] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:29 2022] GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:29.688051 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6ad41af6-8da8-4375-8d7e-3579b9cf5b64 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:29.688695 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6ad41af6-8da8-4375-8d7e-3579b9cf5b64 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: f462aba2-e204-42e0-8f1a-cc25b075bdb9] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:29.695018 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ad41af6-8da8-4375-8d7e-3579b9cf5b64 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:29.695463 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ad41af6-8da8-4375-8d7e-3579b9cf5b64 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:29.696242 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ad41af6-8da8-4375-8d7e-3579b9cf5b64 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:29.696703 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6ad41af6-8da8-4375-8d7e-3579b9cf5b64 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:29.720705 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6ad41af6-8da8-4375-8d7e-3579b9cf5b64 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: f462aba2-e204-42e0-8f1a-cc25b075bdb9] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:44:29.979569 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6ad41af6-8da8-4375-8d7e-3579b9cf5b64 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "DELETE /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9" status: 204 len: 0 microversion: 2.1 time: 0.295964 Feb 21 01:44:29.980249 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 538/1088] 10.222.0.90 () {58 vars in 1238 bytes} [Mon Feb 21 01:44:29 2022] DELETE /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:44:29.989263 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4a2f69af-3fac-4a20-837d-4ccea3517fa6 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:29.989878 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4a2f69af-3fac-4a20-837d-4ccea3517fa6 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: f462aba2-e204-42e0-8f1a-cc25b075bdb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:29.995726 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a2f69af-3fac-4a20-837d-4ccea3517fa6 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:30.001527 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a2f69af-3fac-4a20-837d-4ccea3517fa6 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:30.001527 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a2f69af-3fac-4a20-837d-4ccea3517fa6 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:30.001527 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4a2f69af-3fac-4a20-837d-4ccea3517fa6 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:30.126395 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-4a2f69af-3fac-4a20-837d-4ccea3517fa6 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:30.133589 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4a2f69af-3fac-4a20-837d-4ccea3517fa6 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9" status: 200 len: 1514 microversion: 2.1 time: 0.149022 Feb 21 01:44:30.134154 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 551/1089] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:29 2022] GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:30.555423 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-597d5fd8-9533-4a96-8606-6902a3008d70 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:30.556155 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-597d5fd8-9533-4a96-8606-6902a3008d70 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 487ce617-4be7-4cdd-b23e-f2af1636afe2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:30.563040 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-597d5fd8-9533-4a96-8606-6902a3008d70 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:30.563492 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-597d5fd8-9533-4a96-8606-6902a3008d70 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:30.564268 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-597d5fd8-9533-4a96-8606-6902a3008d70 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:30.564738 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-597d5fd8-9533-4a96-8606-6902a3008d70 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:30.697866 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-597d5fd8-9533-4a96-8606-6902a3008d70 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:30.705336 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-597d5fd8-9533-4a96-8606-6902a3008d70 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2" status: 200 len: 1314 microversion: 2.1 time: 0.154005 Feb 21 01:44:30.705902 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 539/1090] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:30 2022] GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:31.151024 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1594715b-e976-42a3-833b-f9f7d60337ae tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:31.151631 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1594715b-e976-42a3-833b-f9f7d60337ae tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: f462aba2-e204-42e0-8f1a-cc25b075bdb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:31.159207 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1594715b-e976-42a3-833b-f9f7d60337ae tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:31.159207 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1594715b-e976-42a3-833b-f9f7d60337ae tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:31.160005 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1594715b-e976-42a3-833b-f9f7d60337ae tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:31.160105 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1594715b-e976-42a3-833b-f9f7d60337ae tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:31.295974 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1594715b-e976-42a3-833b-f9f7d60337ae tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:31.303257 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1594715b-e976-42a3-833b-f9f7d60337ae tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9" status: 200 len: 1514 microversion: 2.1 time: 0.155996 Feb 21 01:44:31.303852 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 552/1091] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:31 2022] GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:31.722056 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d04e4cab-9c7f-4cfa-9300-7454dc0e883f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:31.722672 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d04e4cab-9c7f-4cfa-9300-7454dc0e883f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 487ce617-4be7-4cdd-b23e-f2af1636afe2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:31.729007 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d04e4cab-9c7f-4cfa-9300-7454dc0e883f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:31.729461 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d04e4cab-9c7f-4cfa-9300-7454dc0e883f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:31.730247 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d04e4cab-9c7f-4cfa-9300-7454dc0e883f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:31.730684 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d04e4cab-9c7f-4cfa-9300-7454dc0e883f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:31.861697 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-d04e4cab-9c7f-4cfa-9300-7454dc0e883f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:31.869022 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d04e4cab-9c7f-4cfa-9300-7454dc0e883f tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2" status: 200 len: 1498 microversion: 2.1 time: 0.150568 Feb 21 01:44:31.869529 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 540/1092] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:31 2022] GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2 => generated 1498 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:32.320025 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-4aa8c617-bb82-40b5-9989-b2418f5f376c tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:32.320668 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-4aa8c617-bb82-40b5-9989-b2418f5f376c tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: f462aba2-e204-42e0-8f1a-cc25b075bdb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:32.326799 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4aa8c617-bb82-40b5-9989-b2418f5f376c tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:32.327237 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4aa8c617-bb82-40b5-9989-b2418f5f376c tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:32.328000 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4aa8c617-bb82-40b5-9989-b2418f5f376c tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:32.328451 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-4aa8c617-bb82-40b5-9989-b2418f5f376c tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:32.500632 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-4aa8c617-bb82-40b5-9989-b2418f5f376c tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:32.509330 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-4aa8c617-bb82-40b5-9989-b2418f5f376c tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9" status: 200 len: 1514 microversion: 2.1 time: 0.192878 Feb 21 01:44:32.509972 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 553/1093] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:32 2022] GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9 => generated 1514 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:32.582901 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-a1233c8c-e044-46fd-839f-f6a4ccde3a48 req-b328866f-cb0a-4da8-a524-f578eb234c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f462aba2-e204-42e0-8f1a-cc25b075bdb9", "name": "network-vif-deleted", "tag": "e7fdbbe1-c0e9-4818-b2de-cc2579613ccf"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:44:32.583437 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c7a129ad-89ae-46d0-882e-126e07c5f40a tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:32.583939 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c7a129ad-89ae-46d0-882e-126e07c5f40a tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 487ce617-4be7-4cdd-b23e-f2af1636afe2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:32.584588 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:44:32.584588 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:44:32.589996 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7a129ad-89ae-46d0-882e-126e07c5f40a tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:32.590449 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7a129ad-89ae-46d0-882e-126e07c5f40a tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:32.591223 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7a129ad-89ae-46d0-882e-126e07c5f40a tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:32.591412 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a1233c8c-e044-46fd-839f-f6a4ccde3a48 req-b328866f-cb0a-4da8-a524-f578eb234c86 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:32.591676 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c7a129ad-89ae-46d0-882e-126e07c5f40a tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:32.592413 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-a1233c8c-e044-46fd-839f-f6a4ccde3a48 req-b328866f-cb0a-4da8-a524-f578eb234c86 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:32.603240 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-a1233c8c-e044-46fd-839f-f6a4ccde3a48 req-b328866f-cb0a-4da8-a524-f578eb234c86 service nova] Creating event network-vif-deleted:e7fdbbe1-c0e9-4818-b2de-cc2579613ccf for instance f462aba2-e204-42e0-8f1a-cc25b075bdb9 on hv-cinder-81322 Feb 21 01:44:32.608582 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-a1233c8c-e044-46fd-839f-f6a4ccde3a48 req-b328866f-cb0a-4da8-a524-f578eb234c86 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029578 Feb 21 01:44:32.609174 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 541/1094] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:44:32.616641 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c7a129ad-89ae-46d0-882e-126e07c5f40a tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 487ce617-4be7-4cdd-b23e-f2af1636afe2] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:44:32.858169 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c7a129ad-89ae-46d0-882e-126e07c5f40a tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "DELETE /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2" status: 204 len: 0 microversion: 2.1 time: 0.278004 Feb 21 01:44:32.858781 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 554/1095] 10.222.0.90 () {58 vars in 1238 bytes} [Mon Feb 21 01:44:32 2022] DELETE /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 21 01:44:32.867768 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1f86375b-ad2f-400d-a1ea-031a79f4cd10 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:32.868493 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1f86375b-ad2f-400d-a1ea-031a79f4cd10 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 487ce617-4be7-4cdd-b23e-f2af1636afe2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:32.874508 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f86375b-ad2f-400d-a1ea-031a79f4cd10 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:32.874953 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f86375b-ad2f-400d-a1ea-031a79f4cd10 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:32.875813 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f86375b-ad2f-400d-a1ea-031a79f4cd10 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:32.876221 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1f86375b-ad2f-400d-a1ea-031a79f4cd10 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:33.008864 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-1f86375b-ad2f-400d-a1ea-031a79f4cd10 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:33.017104 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1f86375b-ad2f-400d-a1ea-031a79f4cd10 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2" status: 200 len: 1504 microversion: 2.1 time: 0.153722 Feb 21 01:44:33.017662 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 542/1096] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:32 2022] GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:33.527741 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-244043b4-067d-40ea-907a-5a4dd076bad8 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:33.528367 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-244043b4-067d-40ea-907a-5a4dd076bad8 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: f462aba2-e204-42e0-8f1a-cc25b075bdb9] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:33.534640 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-244043b4-067d-40ea-907a-5a4dd076bad8 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:33.535093 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-244043b4-067d-40ea-907a-5a4dd076bad8 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:33.535904 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-244043b4-067d-40ea-907a-5a4dd076bad8 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:33.536338 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-244043b4-067d-40ea-907a-5a4dd076bad8 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:33.549774 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-244043b4-067d-40ea-907a-5a4dd076bad8 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] HTTP exception thrown: Instance f462aba2-e204-42e0-8f1a-cc25b075bdb9 could not be found. Feb 21 01:44:33.552395 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-244043b4-067d-40ea-907a-5a4dd076bad8 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Returning 404 to user: Instance f462aba2-e204-42e0-8f1a-cc25b075bdb9 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:44:33.552395 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-244043b4-067d-40ea-907a-5a4dd076bad8 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9" status: 404 len: 111 microversion: 2.1 time: 0.027626 Feb 21 01:44:33.552395 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 555/1097] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:33 2022] GET /compute/v2.1/servers/f462aba2-e204-42e0-8f1a-cc25b075bdb9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:44:34.034319 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d2b27b1c-6d44-48af-9799-78ae720e17ea tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:34.035060 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d2b27b1c-6d44-48af-9799-78ae720e17ea tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 487ce617-4be7-4cdd-b23e-f2af1636afe2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:34.041149 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2b27b1c-6d44-48af-9799-78ae720e17ea tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:34.041608 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2b27b1c-6d44-48af-9799-78ae720e17ea tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:34.042381 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2b27b1c-6d44-48af-9799-78ae720e17ea tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:34.042817 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d2b27b1c-6d44-48af-9799-78ae720e17ea tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:34.173914 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-d2b27b1c-6d44-48af-9799-78ae720e17ea tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:34.181345 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d2b27b1c-6d44-48af-9799-78ae720e17ea tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2" status: 200 len: 1504 microversion: 2.1 time: 0.150651 Feb 21 01:44:34.181906 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 543/1098] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:34 2022] GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:35.139298 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-d3fb72df-0b8d-442a-aecb-2f3da446fa08 req-1fbcc9d2-f32b-4fe2-be0a-f267d33d78e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487ce617-4be7-4cdd-b23e-f2af1636afe2", "name": "network-vif-deleted", "tag": "9ea3d121-7900-4996-b64b-7306ffc721b9"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:44:35.140872 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:44:35.140872 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:44:35.147999 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d3fb72df-0b8d-442a-aecb-2f3da446fa08 req-1fbcc9d2-f32b-4fe2-be0a-f267d33d78e7 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:35.148522 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-d3fb72df-0b8d-442a-aecb-2f3da446fa08 req-1fbcc9d2-f32b-4fe2-be0a-f267d33d78e7 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:35.159652 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-d3fb72df-0b8d-442a-aecb-2f3da446fa08 req-1fbcc9d2-f32b-4fe2-be0a-f267d33d78e7 service nova] Creating event network-vif-deleted:9ea3d121-7900-4996-b64b-7306ffc721b9 for instance 487ce617-4be7-4cdd-b23e-f2af1636afe2 on hv-cinder-81322 Feb 21 01:44:35.164620 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-d3fb72df-0b8d-442a-aecb-2f3da446fa08 req-1fbcc9d2-f32b-4fe2-be0a-f267d33d78e7 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029688 Feb 21 01:44:35.165193 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 556/1099] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:44:35.197153 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-52029b24-df9e-4ad7-a8bb-1b166e4b8ff7 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:35.197762 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-52029b24-df9e-4ad7-a8bb-1b166e4b8ff7 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 487ce617-4be7-4cdd-b23e-f2af1636afe2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:35.204600 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52029b24-df9e-4ad7-a8bb-1b166e4b8ff7 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:35.205735 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52029b24-df9e-4ad7-a8bb-1b166e4b8ff7 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:35.205844 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52029b24-df9e-4ad7-a8bb-1b166e4b8ff7 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:35.206265 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-52029b24-df9e-4ad7-a8bb-1b166e4b8ff7 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:35.272036 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-52029b24-df9e-4ad7-a8bb-1b166e4b8ff7 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:35.279291 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-52029b24-df9e-4ad7-a8bb-1b166e4b8ff7 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2" status: 200 len: 1462 microversion: 2.1 time: 0.085757 Feb 21 01:44:35.285512 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 544/1100] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:35 2022] GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2 => generated 1462 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:36.297127 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2565befb-dec5-4eeb-8253-9aac5e337af5 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:36.297811 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2565befb-dec5-4eeb-8253-9aac5e337af5 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 487ce617-4be7-4cdd-b23e-f2af1636afe2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:36.304304 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2565befb-dec5-4eeb-8253-9aac5e337af5 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:36.304787 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2565befb-dec5-4eeb-8253-9aac5e337af5 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:36.305556 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2565befb-dec5-4eeb-8253-9aac5e337af5 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:36.305990 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2565befb-dec5-4eeb-8253-9aac5e337af5 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:36.366167 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2565befb-dec5-4eeb-8253-9aac5e337af5 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:36.374572 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2565befb-dec5-4eeb-8253-9aac5e337af5 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2" status: 200 len: 1299 microversion: 2.1 time: 0.081914 Feb 21 01:44:36.374919 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 557/1101] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:36 2022] GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2 => generated 1299 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:37.391243 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-ade8147b-975c-4229-a46c-bd56ab36d688 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:37.391914 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-ade8147b-975c-4229-a46c-bd56ab36d688 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 487ce617-4be7-4cdd-b23e-f2af1636afe2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:37.398446 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ade8147b-975c-4229-a46c-bd56ab36d688 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:37.398922 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ade8147b-975c-4229-a46c-bd56ab36d688 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:37.399700 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ade8147b-975c-4229-a46c-bd56ab36d688 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:37.400135 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ade8147b-975c-4229-a46c-bd56ab36d688 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:37.429409 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ade8147b-975c-4229-a46c-bd56ab36d688 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:37.429851 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-ade8147b-975c-4229-a46c-bd56ab36d688 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:37.430295 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-ade8147b-975c-4229-a46c-bd56ab36d688 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lazy-loading 'fault' on Instance uuid 487ce617-4be7-4cdd-b23e-f2af1636afe2 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:44:37.470720 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-ade8147b-975c-4229-a46c-bd56ab36d688 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:37.477862 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-ade8147b-975c-4229-a46c-bd56ab36d688 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2" status: 200 len: 1304 microversion: 2.1 time: 0.090559 Feb 21 01:44:37.478427 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 545/1102] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:37 2022] GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2 => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:44:38.495056 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-82db0fc0-1299-4132-b81c-e55448007223 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:38.495646 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-82db0fc0-1299-4132-b81c-e55448007223 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 487ce617-4be7-4cdd-b23e-f2af1636afe2] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:38.501960 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82db0fc0-1299-4132-b81c-e55448007223 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:38.502418 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82db0fc0-1299-4132-b81c-e55448007223 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:38.503190 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82db0fc0-1299-4132-b81c-e55448007223 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:38.503624 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82db0fc0-1299-4132-b81c-e55448007223 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:38.535480 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82db0fc0-1299-4132-b81c-e55448007223 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:38.535938 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-82db0fc0-1299-4132-b81c-e55448007223 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:38.536385 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-82db0fc0-1299-4132-b81c-e55448007223 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lazy-loading 'fault' on Instance uuid 487ce617-4be7-4cdd-b23e-f2af1636afe2 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:44:38.574694 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-82db0fc0-1299-4132-b81c-e55448007223 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae83f98e32d34dac973b88b778febaec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af4bed604ef4015929214d402588d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:38.582722 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-82db0fc0-1299-4132-b81c-e55448007223 tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2" status: 200 len: 1304 microversion: 2.1 time: 0.091471 Feb 21 01:44:38.583466 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 558/1103] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:38 2022] GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2 => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:39.598572 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3dd68397-6cd3-42ee-8c07-12aeb99efa3e tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:39.599145 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3dd68397-6cd3-42ee-8c07-12aeb99efa3e tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] [instance: 487ce617-4be7-4cdd-b23e-f2af1636afe2] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:39.605306 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dd68397-6cd3-42ee-8c07-12aeb99efa3e tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:39.606876 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dd68397-6cd3-42ee-8c07-12aeb99efa3e tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:39.606876 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dd68397-6cd3-42ee-8c07-12aeb99efa3e tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:39.607110 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3dd68397-6cd3-42ee-8c07-12aeb99efa3e tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:39.621058 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-3dd68397-6cd3-42ee-8c07-12aeb99efa3e tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] HTTP exception thrown: Instance 487ce617-4be7-4cdd-b23e-f2af1636afe2 could not be found. Feb 21 01:44:39.621684 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3dd68397-6cd3-42ee-8c07-12aeb99efa3e tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] Returning 404 to user: Instance 487ce617-4be7-4cdd-b23e-f2af1636afe2 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:44:39.622524 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3dd68397-6cd3-42ee-8c07-12aeb99efa3e tempest-VolumesActionsTest-1485268087 tempest-VolumesActionsTest-1485268087-project] 10.222.0.90 "GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2" status: 404 len: 111 microversion: 2.1 time: 0.027771 Feb 21 01:44:39.623095 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 546/1104] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:39 2022] GET /compute/v2.1/servers/487ce617-4be7-4cdd-b23e-f2af1636afe2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:44:49.117060 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8ea7ef18-1d67-4f73-b464-1ad3442e5eeb tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-487434072", "imageRef": "35936a71-5ec3-4154-b01a-f2dafd8c0364", "flavorRef": "452", "networks": [{"uuid": "5f5b61d0-749a-42d6-a36d-902db889b48a"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:44:49.166724 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-8ea7ef18-1d67-4f73-b464-1ad3442e5eeb tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] validate_networks() for [('5f5b61d0-749a-42d6-a36d-902db889b48a', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:44:49.570339 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-8ea7ef18-1d67-4f73-b464-1ad3442e5eeb tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:44:49.570760 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-8ea7ef18-1d67-4f73-b464-1ad3442e5eeb tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:44:49.571228 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-8ea7ef18-1d67-4f73-b464-1ad3442e5eeb tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:44:49.571636 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-8ea7ef18-1d67-4f73-b464-1ad3442e5eeb tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:44:49.572051 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-8ea7ef18-1d67-4f73-b464-1ad3442e5eeb tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:44:49.580676 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ea7ef18-1d67-4f73-b464-1ad3442e5eeb tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:49.581648 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ea7ef18-1d67-4f73-b464-1ad3442e5eeb tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:49.581923 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ea7ef18-1d67-4f73-b464-1ad3442e5eeb tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:49.582357 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8ea7ef18-1d67-4f73-b464-1ad3442e5eeb tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:49.599261 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-8ea7ef18-1d67-4f73-b464-1ad3442e5eeb tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Getting quotas for project eee074218f5d45c09d213dc996c172b5. Resources: {'ram', 'cores', 'instances'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:44:49.603163 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-8ea7ef18-1d67-4f73-b464-1ad3442e5eeb tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Getting quotas for user 9e6600897456464a8af678bd97146ebf and project eee074218f5d45c09d213dc996c172b5. Resources: {'ram', 'cores', 'instances'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:44:49.614707 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8ea7ef18-1d67-4f73-b464-1ad3442e5eeb tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:44:49.617236 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8ea7ef18-1d67-4f73-b464-1ad3442e5eeb tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: aa3bb09a-d09d-4734-aae7-b8ca6e962ec3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35936a71-5ec3-4154-b01a-f2dafd8c0364',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:44:49.741481 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8ea7ef18-1d67-4f73-b464-1ad3442e5eeb tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627915 Feb 21 01:44:49.742590 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 559/1105] 10.222.0.90 () {60 vars in 1146 bytes} [Mon Feb 21 01:44:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:44:49.755493 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-fa9a5c71-2b16-417e-b493-29fce970bfb7 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:49.756894 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-fa9a5c71-2b16-417e-b493-29fce970bfb7 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: aa3bb09a-d09d-4734-aae7-b8ca6e962ec3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:49.840484 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-fa9a5c71-2b16-417e-b493-29fce970bfb7 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:49.848657 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-fa9a5c71-2b16-417e-b493-29fce970bfb7 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3" status: 200 len: 1218 microversion: 2.1 time: 0.098435 Feb 21 01:44:49.849607 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 547/1106] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:49 2022] GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:50.867649 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-69c738c0-368d-46c6-9732-5728c256ffa2 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:50.871782 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-69c738c0-368d-46c6-9732-5728c256ffa2 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: aa3bb09a-d09d-4734-aae7-b8ca6e962ec3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:50.875774 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-69c738c0-368d-46c6-9732-5728c256ffa2 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:50.876286 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-69c738c0-368d-46c6-9732-5728c256ffa2 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:50.877067 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-69c738c0-368d-46c6-9732-5728c256ffa2 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:50.877550 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-69c738c0-368d-46c6-9732-5728c256ffa2 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:50.959079 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-69c738c0-368d-46c6-9732-5728c256ffa2 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:50.967765 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-69c738c0-368d-46c6-9732-5728c256ffa2 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3" status: 200 len: 1222 microversion: 2.1 time: 0.103894 Feb 21 01:44:50.968235 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 560/1107] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:50 2022] GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3 => generated 1222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:51.993146 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-88682335-5c38-4207-8349-a78d3da2dd7f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:51.994410 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-88682335-5c38-4207-8349-a78d3da2dd7f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: aa3bb09a-d09d-4734-aae7-b8ca6e962ec3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:52.007901 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88682335-5c38-4207-8349-a78d3da2dd7f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:52.009007 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88682335-5c38-4207-8349-a78d3da2dd7f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:52.010797 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88682335-5c38-4207-8349-a78d3da2dd7f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:52.011837 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88682335-5c38-4207-8349-a78d3da2dd7f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:52.134829 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-88682335-5c38-4207-8349-a78d3da2dd7f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:52.145857 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-88682335-5c38-4207-8349-a78d3da2dd7f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3" status: 200 len: 1288 microversion: 2.1 time: 0.159307 Feb 21 01:44:52.145857 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 548/1108] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:51 2022] GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3 => generated 1288 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:53.159789 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f1082c49-b546-40c8-9089-46a84ae87873 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:53.160393 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f1082c49-b546-40c8-9089-46a84ae87873 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: aa3bb09a-d09d-4734-aae7-b8ca6e962ec3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:53.171376 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f1082c49-b546-40c8-9089-46a84ae87873 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:53.172004 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f1082c49-b546-40c8-9089-46a84ae87873 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:53.177740 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f1082c49-b546-40c8-9089-46a84ae87873 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:53.178432 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f1082c49-b546-40c8-9089-46a84ae87873 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:53.551335 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-f1082c49-b546-40c8-9089-46a84ae87873 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:53.561231 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f1082c49-b546-40c8-9089-46a84ae87873 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3" status: 200 len: 1318 microversion: 2.1 time: 0.404578 Feb 21 01:44:53.571342 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 561/1109] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:53 2022] GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3 => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:54.115292 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-ecf5fdab-b96e-4eb2-aa01-d45190f31e54 req-b8eae977-8e27-423f-8a4e-c56de9c9760c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa3bb09a-d09d-4734-aae7-b8ca6e962ec3", "tag": "c468ab7b-60ba-4b65-a146-8e905b131d91"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:44:54.120636 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:44:54.120636 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:44:54.134262 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ecf5fdab-b96e-4eb2-aa01-d45190f31e54 req-b8eae977-8e27-423f-8a4e-c56de9c9760c service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:54.134955 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-ecf5fdab-b96e-4eb2-aa01-d45190f31e54 req-b8eae977-8e27-423f-8a4e-c56de9c9760c service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:54.148396 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-ecf5fdab-b96e-4eb2-aa01-d45190f31e54 req-b8eae977-8e27-423f-8a4e-c56de9c9760c service nova] Creating event network-changed:c468ab7b-60ba-4b65-a146-8e905b131d91 for instance aa3bb09a-d09d-4734-aae7-b8ca6e962ec3 on hv-cinder-81322 Feb 21 01:44:54.153869 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-ecf5fdab-b96e-4eb2-aa01-d45190f31e54 req-b8eae977-8e27-423f-8a4e-c56de9c9760c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042194 Feb 21 01:44:54.155514 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 549/1110] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:44:54.582355 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f77e3953-0a78-41de-abc7-4dca8141dc32 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:54.583671 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f77e3953-0a78-41de-abc7-4dca8141dc32 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: aa3bb09a-d09d-4734-aae7-b8ca6e962ec3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:54.592723 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f77e3953-0a78-41de-abc7-4dca8141dc32 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:54.593536 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f77e3953-0a78-41de-abc7-4dca8141dc32 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:54.595129 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f77e3953-0a78-41de-abc7-4dca8141dc32 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:54.595818 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f77e3953-0a78-41de-abc7-4dca8141dc32 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:54.863464 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-f77e3953-0a78-41de-abc7-4dca8141dc32 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:54.881651 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f77e3953-0a78-41de-abc7-4dca8141dc32 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3" status: 200 len: 1318 microversion: 2.1 time: 0.306302 Feb 21 01:44:54.891710 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 562/1111] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:54 2022] GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3 => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:55.900114 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e9e19f89-fa1d-4ce3-a099-867be8a49a71 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:55.901456 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e9e19f89-fa1d-4ce3-a099-867be8a49a71 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: aa3bb09a-d09d-4734-aae7-b8ca6e962ec3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:55.908641 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9e19f89-fa1d-4ce3-a099-867be8a49a71 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:55.909167 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9e19f89-fa1d-4ce3-a099-867be8a49a71 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:55.910010 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9e19f89-fa1d-4ce3-a099-867be8a49a71 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:55.910640 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e9e19f89-fa1d-4ce3-a099-867be8a49a71 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:56.075395 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-e9e19f89-fa1d-4ce3-a099-867be8a49a71 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:56.084175 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e9e19f89-fa1d-4ce3-a099-867be8a49a71 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3" status: 200 len: 1318 microversion: 2.1 time: 0.188462 Feb 21 01:44:56.085061 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 550/1112] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:55 2022] GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:57.103908 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2784e6d5-07c0-4887-9e7b-46519fac827b tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:57.104914 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2784e6d5-07c0-4887-9e7b-46519fac827b tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: aa3bb09a-d09d-4734-aae7-b8ca6e962ec3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:57.113665 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2784e6d5-07c0-4887-9e7b-46519fac827b tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:57.114233 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2784e6d5-07c0-4887-9e7b-46519fac827b tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:57.116838 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2784e6d5-07c0-4887-9e7b-46519fac827b tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:57.117295 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2784e6d5-07c0-4887-9e7b-46519fac827b tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:57.274346 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-2784e6d5-07c0-4887-9e7b-46519fac827b tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:57.282744 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2784e6d5-07c0-4887-9e7b-46519fac827b tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3" status: 200 len: 1318 microversion: 2.1 time: 0.184596 Feb 21 01:44:57.288653 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 563/1113] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:57 2022] GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:58.304266 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-c4f09565-9253-4ec4-b737-ee7e8e1af4e8 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:58.304984 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-c4f09565-9253-4ec4-b737-ee7e8e1af4e8 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: aa3bb09a-d09d-4734-aae7-b8ca6e962ec3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:58.311624 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4f09565-9253-4ec4-b737-ee7e8e1af4e8 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:58.312078 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4f09565-9253-4ec4-b737-ee7e8e1af4e8 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:58.314163 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4f09565-9253-4ec4-b737-ee7e8e1af4e8 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:58.314609 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-c4f09565-9253-4ec4-b737-ee7e8e1af4e8 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:58.461779 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-c4f09565-9253-4ec4-b737-ee7e8e1af4e8 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:58.481013 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-c4f09565-9253-4ec4-b737-ee7e8e1af4e8 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3" status: 200 len: 1318 microversion: 2.1 time: 0.180374 Feb 21 01:44:58.483717 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 551/1114] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:58 2022] GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:44:59.499491 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9614c0a6-452f-4111-84da-5a6ea4c1153c tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:44:59.500332 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9614c0a6-452f-4111-84da-5a6ea4c1153c tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: aa3bb09a-d09d-4734-aae7-b8ca6e962ec3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:44:59.508329 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9614c0a6-452f-4111-84da-5a6ea4c1153c tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:59.508961 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9614c0a6-452f-4111-84da-5a6ea4c1153c tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:59.510003 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9614c0a6-452f-4111-84da-5a6ea4c1153c tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:44:59.510381 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9614c0a6-452f-4111-84da-5a6ea4c1153c tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:44:59.668747 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-9614c0a6-452f-4111-84da-5a6ea4c1153c tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:44:59.677298 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9614c0a6-452f-4111-84da-5a6ea4c1153c tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3" status: 200 len: 1318 microversion: 2.1 time: 0.181938 Feb 21 01:44:59.678433 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 564/1115] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:44:59 2022] GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:00.697416 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0fa922c4-fcd5-4994-b787-ed0f3465cb94 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:00.698818 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0fa922c4-fcd5-4994-b787-ed0f3465cb94 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: aa3bb09a-d09d-4734-aae7-b8ca6e962ec3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:00.705667 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0fa922c4-fcd5-4994-b787-ed0f3465cb94 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:00.706224 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0fa922c4-fcd5-4994-b787-ed0f3465cb94 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:00.707156 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0fa922c4-fcd5-4994-b787-ed0f3465cb94 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:00.707670 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0fa922c4-fcd5-4994-b787-ed0f3465cb94 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:00.859845 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-0fa922c4-fcd5-4994-b787-ed0f3465cb94 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:00.868461 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0fa922c4-fcd5-4994-b787-ed0f3465cb94 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3" status: 200 len: 1318 microversion: 2.1 time: 0.176763 Feb 21 01:45:00.869048 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 552/1116] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:00 2022] GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:01.886931 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e2308726-3410-443a-b7a6-14d5efb7d47f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:01.887719 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e2308726-3410-443a-b7a6-14d5efb7d47f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: aa3bb09a-d09d-4734-aae7-b8ca6e962ec3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:01.896806 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2308726-3410-443a-b7a6-14d5efb7d47f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:01.897258 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2308726-3410-443a-b7a6-14d5efb7d47f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:01.898044 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2308726-3410-443a-b7a6-14d5efb7d47f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:01.898475 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e2308726-3410-443a-b7a6-14d5efb7d47f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:02.073006 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-e2308726-3410-443a-b7a6-14d5efb7d47f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:02.081525 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e2308726-3410-443a-b7a6-14d5efb7d47f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3" status: 200 len: 1318 microversion: 2.1 time: 0.198297 Feb 21 01:45:02.088970 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 565/1117] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:01 2022] GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:02.176667 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-8c252826-bdc7-41b7-8032-75a1d247d122 req-1e74eb53-656b-43ea-aa12-6fda2a8bb4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3bb09a-d09d-4734-aae7-b8ca6e962ec3", "name": "network-vif-plugged", "status": "completed", "tag": "c468ab7b-60ba-4b65-a146-8e905b131d91"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:45:02.179062 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:45:02.179062 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:45:02.187935 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8c252826-bdc7-41b7-8032-75a1d247d122 req-1e74eb53-656b-43ea-aa12-6fda2a8bb4d2 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:02.188811 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-8c252826-bdc7-41b7-8032-75a1d247d122 req-1e74eb53-656b-43ea-aa12-6fda2a8bb4d2 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:02.202787 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-8c252826-bdc7-41b7-8032-75a1d247d122 req-1e74eb53-656b-43ea-aa12-6fda2a8bb4d2 service nova] Creating event network-vif-plugged:c468ab7b-60ba-4b65-a146-8e905b131d91 for instance aa3bb09a-d09d-4734-aae7-b8ca6e962ec3 on hv-cinder-81322 Feb 21 01:45:02.208021 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-8c252826-bdc7-41b7-8032-75a1d247d122 req-1e74eb53-656b-43ea-aa12-6fda2a8bb4d2 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035259 Feb 21 01:45:02.209517 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 553/1118] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:45:03.098469 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-9c291162-621e-44ee-b222-3ca50c93646f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:03.099255 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-9c291162-621e-44ee-b222-3ca50c93646f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: aa3bb09a-d09d-4734-aae7-b8ca6e962ec3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:03.108811 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c291162-621e-44ee-b222-3ca50c93646f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:03.109509 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c291162-621e-44ee-b222-3ca50c93646f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:03.110761 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c291162-621e-44ee-b222-3ca50c93646f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:03.111333 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-9c291162-621e-44ee-b222-3ca50c93646f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:03.263475 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-9c291162-621e-44ee-b222-3ca50c93646f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:03.271313 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-9c291162-621e-44ee-b222-3ca50c93646f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3" status: 200 len: 1318 microversion: 2.1 time: 0.176771 Feb 21 01:45:03.272211 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 566/1119] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:03 2022] GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:04.291883 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-674f2457-3015-4746-8384-ff07ed3dfd0c tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:04.293455 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-674f2457-3015-4746-8384-ff07ed3dfd0c tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: aa3bb09a-d09d-4734-aae7-b8ca6e962ec3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:04.304736 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-674f2457-3015-4746-8384-ff07ed3dfd0c tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:04.305438 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-674f2457-3015-4746-8384-ff07ed3dfd0c tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:04.306224 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-674f2457-3015-4746-8384-ff07ed3dfd0c tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:04.306655 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-674f2457-3015-4746-8384-ff07ed3dfd0c tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:04.457536 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-674f2457-3015-4746-8384-ff07ed3dfd0c tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:04.466050 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-674f2457-3015-4746-8384-ff07ed3dfd0c tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3" status: 200 len: 1507 microversion: 2.1 time: 0.178676 Feb 21 01:45:04.478550 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 554/1120] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:04 2022] GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3 => generated 1507 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:04.484559 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d78aa694-3b05-4997-96b2-1666bf3ded7e tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e70a2df-9227-4658-b498-358ecb87c4bb", "device": "/dev/sdb"}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:45:04.486159 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d78aa694-3b05-4997-96b2-1666bf3ded7e tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: aa3bb09a-d09d-4734-aae7-b8ca6e962ec3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:04.495490 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d78aa694-3b05-4997-96b2-1666bf3ded7e tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:04.496339 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d78aa694-3b05-4997-96b2-1666bf3ded7e tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:04.497304 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d78aa694-3b05-4997-96b2-1666bf3ded7e tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:04.498361 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d78aa694-3b05-4997-96b2-1666bf3ded7e tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:05.314445 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d78aa694-3b05-4997-96b2-1666bf3ded7e tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "POST /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.834426 Feb 21 01:45:05.315045 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 567/1121] 10.222.0.90 () {60 vars in 1322 bytes} [Mon Feb 21 01:45:04 2022] POST /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3/os-volume_attachments => generated 194 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:45:29.301328 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-912fc545-fbc0-4c30-8128-65a3687d2aef tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:29.303567 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-912fc545-fbc0-4c30-8128-65a3687d2aef tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: aa3bb09a-d09d-4734-aae7-b8ca6e962ec3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:29.308362 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-912fc545-fbc0-4c30-8128-65a3687d2aef tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:29.308847 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-912fc545-fbc0-4c30-8128-65a3687d2aef tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:29.309638 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-912fc545-fbc0-4c30-8128-65a3687d2aef tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:29.310075 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-912fc545-fbc0-4c30-8128-65a3687d2aef tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:29.392777 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-912fc545-fbc0-4c30-8128-65a3687d2aef tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lazy-loading 'services' on Instance uuid aa3bb09a-d09d-4734-aae7-b8ca6e962ec3 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:45:29.681631 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-912fc545-fbc0-4c30-8128-65a3687d2aef tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "DELETE /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3/os-volume_attachments/0e70a2df-9227-4658-b498-358ecb87c4bb" status: 202 len: 0 microversion: 2.1 time: 0.385693 Feb 21 01:45:29.682257 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 555/1122] 10.222.0.90 () {58 vars in 1415 bytes} [Mon Feb 21 01:45:29 2022] DELETE /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3/os-volume_attachments/0e70a2df-9227-4658-b498-358ecb87c4bb => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:45:30.806325 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-7492e878-0b45-428c-9144-1f5911d0262f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:30.806905 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7492e878-0b45-428c-9144-1f5911d0262f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: aa3bb09a-d09d-4734-aae7-b8ca6e962ec3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:30.812866 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7492e878-0b45-428c-9144-1f5911d0262f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:30.815819 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7492e878-0b45-428c-9144-1f5911d0262f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:30.815819 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7492e878-0b45-428c-9144-1f5911d0262f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:30.815819 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-7492e878-0b45-428c-9144-1f5911d0262f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:30.837949 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-7492e878-0b45-428c-9144-1f5911d0262f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: aa3bb09a-d09d-4734-aae7-b8ca6e962ec3] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:45:31.150086 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-7492e878-0b45-428c-9144-1f5911d0262f tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "DELETE /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3" status: 204 len: 0 microversion: 2.1 time: 0.347918 Feb 21 01:45:31.150677 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 568/1123] 10.222.0.90 () {58 vars in 1238 bytes} [Mon Feb 21 01:45:30 2022] DELETE /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:45:31.160360 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-af7988a7-063b-497f-886b-4b135d50e6cd tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:31.161090 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-af7988a7-063b-497f-886b-4b135d50e6cd tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: aa3bb09a-d09d-4734-aae7-b8ca6e962ec3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:31.167251 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af7988a7-063b-497f-886b-4b135d50e6cd tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:31.167694 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af7988a7-063b-497f-886b-4b135d50e6cd tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:31.168490 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af7988a7-063b-497f-886b-4b135d50e6cd tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:31.168925 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-af7988a7-063b-497f-886b-4b135d50e6cd tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:31.297078 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-af7988a7-063b-497f-886b-4b135d50e6cd tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:31.304456 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-af7988a7-063b-497f-886b-4b135d50e6cd tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3" status: 200 len: 1513 microversion: 2.1 time: 0.148626 Feb 21 01:45:31.305047 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 556/1124] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:31 2022] GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:32.322315 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5dcc45f6-4808-4f9b-8891-4b835035cab1 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:32.322944 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5dcc45f6-4808-4f9b-8891-4b835035cab1 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: aa3bb09a-d09d-4734-aae7-b8ca6e962ec3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:32.329844 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5dcc45f6-4808-4f9b-8891-4b835035cab1 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:32.330288 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5dcc45f6-4808-4f9b-8891-4b835035cab1 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:32.331063 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5dcc45f6-4808-4f9b-8891-4b835035cab1 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:32.331500 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5dcc45f6-4808-4f9b-8891-4b835035cab1 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:32.458212 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-5dcc45f6-4808-4f9b-8891-4b835035cab1 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:32.465489 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5dcc45f6-4808-4f9b-8891-4b835035cab1 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3" status: 200 len: 1513 microversion: 2.1 time: 0.147289 Feb 21 01:45:32.466558 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 569/1125] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:32 2022] GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:33.483342 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-925e663f-a1ef-41b4-b210-ec96d5759af5 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:33.483978 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-925e663f-a1ef-41b4-b210-ec96d5759af5 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: aa3bb09a-d09d-4734-aae7-b8ca6e962ec3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:33.490015 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-925e663f-a1ef-41b4-b210-ec96d5759af5 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:33.490471 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-925e663f-a1ef-41b4-b210-ec96d5759af5 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:33.491251 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-925e663f-a1ef-41b4-b210-ec96d5759af5 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:33.491689 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-925e663f-a1ef-41b4-b210-ec96d5759af5 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:33.625388 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-925e663f-a1ef-41b4-b210-ec96d5759af5 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:33.632576 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-925e663f-a1ef-41b4-b210-ec96d5759af5 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3" status: 200 len: 1513 microversion: 2.1 time: 0.153432 Feb 21 01:45:33.633137 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 557/1126] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:33 2022] GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:34.022453 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:45:34.022690 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: Mon Feb 21 01:45:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:45:34.346918 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-3327819a-6fb7-4b41-8791-92d8f0744f7b req-6b4c2529-0967-4bc5-9e16-71027bf6c76b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3bb09a-d09d-4734-aae7-b8ca6e962ec3", "name": "network-vif-deleted", "tag": "c468ab7b-60ba-4b65-a146-8e905b131d91"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:45:34.348568 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:45:34.348568 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:45:34.355791 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-3327819a-6fb7-4b41-8791-92d8f0744f7b req-6b4c2529-0967-4bc5-9e16-71027bf6c76b service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:34.356227 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-3327819a-6fb7-4b41-8791-92d8f0744f7b req-6b4c2529-0967-4bc5-9e16-71027bf6c76b service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:34.367273 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-3327819a-6fb7-4b41-8791-92d8f0744f7b req-6b4c2529-0967-4bc5-9e16-71027bf6c76b service nova] Creating event network-vif-deleted:c468ab7b-60ba-4b65-a146-8e905b131d91 for instance aa3bb09a-d09d-4734-aae7-b8ca6e962ec3 on hv-cinder-81322 Feb 21 01:45:34.372358 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-3327819a-6fb7-4b41-8791-92d8f0744f7b req-6b4c2529-0967-4bc5-9e16-71027bf6c76b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029017 Feb 21 01:45:34.373509 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 570/1127] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:45:34.649624 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-3b93cac7-3a6c-4f25-b9da-38abef2a4103 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:34.650247 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-3b93cac7-3a6c-4f25-b9da-38abef2a4103 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: aa3bb09a-d09d-4734-aae7-b8ca6e962ec3] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:34.657102 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b93cac7-3a6c-4f25-b9da-38abef2a4103 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:34.657555 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b93cac7-3a6c-4f25-b9da-38abef2a4103 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:34.658335 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b93cac7-3a6c-4f25-b9da-38abef2a4103 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:34.658770 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b93cac7-3a6c-4f25-b9da-38abef2a4103 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:34.689670 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b93cac7-3a6c-4f25-b9da-38abef2a4103 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:34.690121 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-3b93cac7-3a6c-4f25-b9da-38abef2a4103 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:34.690567 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-3b93cac7-3a6c-4f25-b9da-38abef2a4103 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lazy-loading 'fault' on Instance uuid aa3bb09a-d09d-4734-aae7-b8ca6e962ec3 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:45:34.732935 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-3b93cac7-3a6c-4f25-b9da-38abef2a4103 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e6600897456464a8af678bd97146ebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee074218f5d45c09d213dc996c172b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:34.740078 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-3b93cac7-3a6c-4f25-b9da-38abef2a4103 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3" status: 200 len: 1308 microversion: 2.1 time: 0.094223 Feb 21 01:45:34.740661 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 558/1128] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:34 2022] GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3 => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:35.761692 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8dd622c5-abf2-4224-b007-ed6a5f5bbea4 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:35.762390 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-8dd622c5-abf2-4224-b007-ed6a5f5bbea4 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] [instance: aa3bb09a-d09d-4734-aae7-b8ca6e962ec3] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:35.772319 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dd622c5-abf2-4224-b007-ed6a5f5bbea4 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:35.773071 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dd622c5-abf2-4224-b007-ed6a5f5bbea4 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:35.773861 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dd622c5-abf2-4224-b007-ed6a5f5bbea4 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:35.774344 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-8dd622c5-abf2-4224-b007-ed6a5f5bbea4 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:35.788339 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-8dd622c5-abf2-4224-b007-ed6a5f5bbea4 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] HTTP exception thrown: Instance aa3bb09a-d09d-4734-aae7-b8ca6e962ec3 could not be found. Feb 21 01:45:35.788951 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-8dd622c5-abf2-4224-b007-ed6a5f5bbea4 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] Returning 404 to user: Instance aa3bb09a-d09d-4734-aae7-b8ca6e962ec3 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:45:35.789775 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-8dd622c5-abf2-4224-b007-ed6a5f5bbea4 tempest-VolumesSnapshotTestJSON-606525917 tempest-VolumesSnapshotTestJSON-606525917-project] 10.222.0.90 "GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3" status: 404 len: 111 microversion: 2.1 time: 0.032170 Feb 21 01:45:35.790310 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 571/1129] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:35 2022] GET /compute/v2.1/servers/aa3bb09a-d09d-4734-aae7-b8ca6e962ec3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:45:43.782838 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-21dede15-7497-4eae-b087-b932e4e007c6 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:43.783393 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-21dede15-7497-4eae-b087-b932e4e007c6 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:43.789429 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21dede15-7497-4eae-b087-b932e4e007c6 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:43.789897 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21dede15-7497-4eae-b087-b932e4e007c6 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:43.790668 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21dede15-7497-4eae-b087-b932e4e007c6 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:43.791095 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-21dede15-7497-4eae-b087-b932e4e007c6 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:43.815737 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-21dede15-7497-4eae-b087-b932e4e007c6 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:45:44.081944 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-21dede15-7497-4eae-b087-b932e4e007c6 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "DELETE /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18" status: 204 len: 0 microversion: 2.1 time: 0.303164 Feb 21 01:45:44.082465 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 559/1130] 10.222.0.90 () {58 vars in 1238 bytes} [Mon Feb 21 01:45:43 2022] DELETE /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:45:44.090263 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-cd95f620-674a-45d3-b130-2f26995d42e5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:44.090888 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-cd95f620-674a-45d3-b130-2f26995d42e5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:44.097427 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd95f620-674a-45d3-b130-2f26995d42e5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:44.097883 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd95f620-674a-45d3-b130-2f26995d42e5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:44.098686 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd95f620-674a-45d3-b130-2f26995d42e5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:44.099125 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-cd95f620-674a-45d3-b130-2f26995d42e5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:44.234626 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-cd95f620-674a-45d3-b130-2f26995d42e5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:44.242085 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-cd95f620-674a-45d3-b130-2f26995d42e5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18" status: 200 len: 1579 microversion: 2.1 time: 0.155547 Feb 21 01:45:44.242643 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 572/1131] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:44 2022] GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18 => generated 1579 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:45.260024 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-13554f46-e6d9-4bfb-8564-3612553b77f0 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:45.260792 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-13554f46-e6d9-4bfb-8564-3612553b77f0 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:45.267881 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13554f46-e6d9-4bfb-8564-3612553b77f0 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:45.268327 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13554f46-e6d9-4bfb-8564-3612553b77f0 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:45.269135 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13554f46-e6d9-4bfb-8564-3612553b77f0 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:45.269564 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-13554f46-e6d9-4bfb-8564-3612553b77f0 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:45.406767 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-13554f46-e6d9-4bfb-8564-3612553b77f0 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:45.414013 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-13554f46-e6d9-4bfb-8564-3612553b77f0 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18" status: 200 len: 1579 microversion: 2.1 time: 0.158040 Feb 21 01:45:45.414564 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 560/1132] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:45 2022] GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18 => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:46.430951 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1ed713fa-000e-48c4-8f21-d5362d86f67f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:46.431655 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1ed713fa-000e-48c4-8f21-d5362d86f67f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:46.438440 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ed713fa-000e-48c4-8f21-d5362d86f67f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:46.438910 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ed713fa-000e-48c4-8f21-d5362d86f67f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:46.439664 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ed713fa-000e-48c4-8f21-d5362d86f67f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:46.440094 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1ed713fa-000e-48c4-8f21-d5362d86f67f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:46.615577 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1ed713fa-000e-48c4-8f21-d5362d86f67f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:46.615577 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1ed713fa-000e-48c4-8f21-d5362d86f67f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18" status: 200 len: 1579 microversion: 2.1 time: 0.187251 Feb 21 01:45:46.615577 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 573/1133] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:46 2022] GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18 => generated 1579 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:46.914356 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-0164913c-72de-4c6c-a63f-1db12fbebd0a req-6779dc24-6b24-4c9a-9884-1153e2a8a668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28ebc3bf-d635-4c37-869a-261c9ec07c18", "name": "network-vif-deleted", "tag": "75fcf9e4-d75d-42b6-a1f3-4f77b840ca06"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:45:46.915929 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:45:46.915929 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:45:46.923731 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-0164913c-72de-4c6c-a63f-1db12fbebd0a req-6779dc24-6b24-4c9a-9884-1153e2a8a668 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:46.924473 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-0164913c-72de-4c6c-a63f-1db12fbebd0a req-6779dc24-6b24-4c9a-9884-1153e2a8a668 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:46.934717 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-0164913c-72de-4c6c-a63f-1db12fbebd0a req-6779dc24-6b24-4c9a-9884-1153e2a8a668 service nova] Creating event network-vif-deleted:75fcf9e4-d75d-42b6-a1f3-4f77b840ca06 for instance 28ebc3bf-d635-4c37-869a-261c9ec07c18 on hv-cinder-81322 Feb 21 01:45:46.940318 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-0164913c-72de-4c6c-a63f-1db12fbebd0a req-6779dc24-6b24-4c9a-9884-1153e2a8a668 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029586 Feb 21 01:45:46.940942 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 561/1134] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:45:47.640806 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1589ed40-35a7-429c-965a-4bf649703c6d tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:47.641427 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1589ed40-35a7-429c-965a-4bf649703c6d tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:47.647826 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1589ed40-35a7-429c-965a-4bf649703c6d tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:47.648269 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1589ed40-35a7-429c-965a-4bf649703c6d tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:47.649132 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1589ed40-35a7-429c-965a-4bf649703c6d tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:47.649584 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1589ed40-35a7-429c-965a-4bf649703c6d tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:47.681780 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1589ed40-35a7-429c-965a-4bf649703c6d tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:47.682163 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1589ed40-35a7-429c-965a-4bf649703c6d tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:47.682617 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.objects.instance [None req-1589ed40-35a7-429c-965a-4bf649703c6d tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lazy-loading 'fault' on Instance uuid 28ebc3bf-d635-4c37-869a-261c9ec07c18 {{(pid=123541) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:45:47.749624 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1589ed40-35a7-429c-965a-4bf649703c6d tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:47.758184 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1589ed40-35a7-429c-965a-4bf649703c6d tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18" status: 200 len: 1231 microversion: 2.1 time: 0.130245 Feb 21 01:45:47.758859 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 574/1135] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:47 2022] GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18 => generated 1231 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:48.776645 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-404fa679-6377-4957-b620-07926b8d542f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:48.777341 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-404fa679-6377-4957-b620-07926b8d542f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:48.783311 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-404fa679-6377-4957-b620-07926b8d542f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:48.783751 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-404fa679-6377-4957-b620-07926b8d542f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:48.784538 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-404fa679-6377-4957-b620-07926b8d542f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:48.784966 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-404fa679-6377-4957-b620-07926b8d542f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:48.797599 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-404fa679-6377-4957-b620-07926b8d542f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] HTTP exception thrown: Instance 28ebc3bf-d635-4c37-869a-261c9ec07c18 could not be found. Feb 21 01:45:48.798165 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-404fa679-6377-4957-b620-07926b8d542f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Returning 404 to user: Instance 28ebc3bf-d635-4c37-869a-261c9ec07c18 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:45:48.798958 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-404fa679-6377-4957-b620-07926b8d542f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18" status: 404 len: 111 microversion: 2.1 time: 0.026811 Feb 21 01:45:48.799465 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 562/1136] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:48 2022] GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:45:48.887985 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ca28ee5f-c5ea-4e30-89aa-12ffc9948e9e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1472352477", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1828841158", "security_groups": [{"name": "tempest-secgroup-smoke-1551254502"}], "block_device_mapping_v2": [{"uuid": "f6e56dda-4752-4041-afda-44fb26b00128", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "05842dab-dc3d-4a7b-83c4-206a5c07022d"}]}} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:45:49.171033 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.network.neutron [None req-ca28ee5f-c5ea-4e30-89aa-12ffc9948e9e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] validate_networks() for [('05842dab-dc3d-4a7b-83c4-206a5c07022d', None, None, None, None, None)] {{(pid=123541) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:45:49.786932 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-ca28ee5f-c5ea-4e30-89aa-12ffc9948e9e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Flavor limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:45:49.787356 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-ca28ee5f-c5ea-4e30-89aa-12ffc9948e9e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Image limits 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:45:49.787826 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-ca28ee5f-c5ea-4e30-89aa-12ffc9948e9e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Flavor pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:45:49.788233 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-ca28ee5f-c5ea-4e30-89aa-12ffc9948e9e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Image pref 0:0:0 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:45:49.788682 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.virt.hardware [None req-ca28ee5f-c5ea-4e30-89aa-12ffc9948e9e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123541) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:45:49.797574 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ca28ee5f-c5ea-4e30-89aa-12ffc9948e9e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:49.798039 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ca28ee5f-c5ea-4e30-89aa-12ffc9948e9e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:49.798845 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ca28ee5f-c5ea-4e30-89aa-12ffc9948e9e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:49.799276 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ca28ee5f-c5ea-4e30-89aa-12ffc9948e9e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:49.815473 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-ca28ee5f-c5ea-4e30-89aa-12ffc9948e9e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Getting quotas for project 94593ad3d3934da1ab80ce0c851c7d3e. Resources: {'ram', 'cores', 'instances'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:45:49.819284 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.quota [None req-ca28ee5f-c5ea-4e30-89aa-12ffc9948e9e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Getting quotas for user fa4b889b3aff47cea0a0d254870515cd and project 94593ad3d3934da1ab80ce0c851c7d3e. Resources: {'ram', 'cores', 'instances'} {{(pid=123541) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:45:49.877407 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ca28ee5f-c5ea-4e30-89aa-12ffc9948e9e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Going to run 1 instances... {{(pid=123541) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:45:49.879502 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ca28ee5f-c5ea-4e30-89aa-12ffc9948e9e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: e48dbd5c-1891-4127-88f0-b5fc420b3050] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f6e56dda-4752-4041-afda-44fb26b00128',volume_size=None,volume_type=None)] {{(pid=123541) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:45:50.286163 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ca28ee5f-c5ea-4e30-89aa-12ffc9948e9e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.401998 Feb 21 01:45:50.286899 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 575/1137] 10.222.0.90 () {60 vars in 1146 bytes} [Mon Feb 21 01:45:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1403 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:45:50.296661 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-06e19913-ad66-41e0-b839-285245c39d85 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:50.297286 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-06e19913-ad66-41e0-b839-285245c39d85 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: e48dbd5c-1891-4127-88f0-b5fc420b3050] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:50.350058 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-06e19913-ad66-41e0-b839-285245c39d85 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:50.356577 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-06e19913-ad66-41e0-b839-285245c39d85 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050" status: 200 len: 1095 microversion: 2.1 time: 0.063548 Feb 21 01:45:50.357351 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 563/1138] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:50 2022] GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050 => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:51.373196 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-765f08df-4e56-462b-b74d-f03250a12136 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:51.374638 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-765f08df-4e56-462b-b74d-f03250a12136 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: e48dbd5c-1891-4127-88f0-b5fc420b3050] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:51.381782 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-765f08df-4e56-462b-b74d-f03250a12136 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:51.382557 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-765f08df-4e56-462b-b74d-f03250a12136 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:51.383911 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-765f08df-4e56-462b-b74d-f03250a12136 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:51.384717 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-765f08df-4e56-462b-b74d-f03250a12136 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:51.444945 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-765f08df-4e56-462b-b74d-f03250a12136 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:51.452394 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-765f08df-4e56-462b-b74d-f03250a12136 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050" status: 200 len: 1145 microversion: 2.1 time: 0.082865 Feb 21 01:45:51.452961 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 576/1139] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:51 2022] GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:52.469615 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7262df22-ff36-4fbd-b4a6-39ba898b8b0e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:52.470165 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7262df22-ff36-4fbd-b4a6-39ba898b8b0e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: e48dbd5c-1891-4127-88f0-b5fc420b3050] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:52.477152 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7262df22-ff36-4fbd-b4a6-39ba898b8b0e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:52.477612 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7262df22-ff36-4fbd-b4a6-39ba898b8b0e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:52.484568 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7262df22-ff36-4fbd-b4a6-39ba898b8b0e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:52.484568 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7262df22-ff36-4fbd-b4a6-39ba898b8b0e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:52.536406 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-7262df22-ff36-4fbd-b4a6-39ba898b8b0e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:52.543533 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7262df22-ff36-4fbd-b4a6-39ba898b8b0e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050" status: 200 len: 1137 microversion: 2.1 time: 0.078334 Feb 21 01:45:52.544093 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 564/1140] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:52 2022] GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050 => generated 1137 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:53.560926 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-f6044bdb-181a-41a2-8b2a-d01767d101b5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:53.561541 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-f6044bdb-181a-41a2-8b2a-d01767d101b5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: e48dbd5c-1891-4127-88f0-b5fc420b3050] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:53.568484 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6044bdb-181a-41a2-8b2a-d01767d101b5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:53.568935 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6044bdb-181a-41a2-8b2a-d01767d101b5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:53.569862 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6044bdb-181a-41a2-8b2a-d01767d101b5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:53.570294 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-f6044bdb-181a-41a2-8b2a-d01767d101b5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:53.647536 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-f6044bdb-181a-41a2-8b2a-d01767d101b5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:53.654900 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-f6044bdb-181a-41a2-8b2a-d01767d101b5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050" status: 200 len: 1211 microversion: 2.1 time: 0.098619 Feb 21 01:45:53.655554 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 577/1141] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:53 2022] GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050 => generated 1211 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:54.681169 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d4b8db9e-3aef-455f-9215-5dfb45f0ec45 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:54.682379 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d4b8db9e-3aef-455f-9215-5dfb45f0ec45 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: e48dbd5c-1891-4127-88f0-b5fc420b3050] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:54.697597 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4b8db9e-3aef-455f-9215-5dfb45f0ec45 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:54.699946 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4b8db9e-3aef-455f-9215-5dfb45f0ec45 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:54.699946 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4b8db9e-3aef-455f-9215-5dfb45f0ec45 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:54.699946 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d4b8db9e-3aef-455f-9215-5dfb45f0ec45 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:54.874017 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-d4b8db9e-3aef-455f-9215-5dfb45f0ec45 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:54.881405 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d4b8db9e-3aef-455f-9215-5dfb45f0ec45 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050" status: 200 len: 1279 microversion: 2.1 time: 0.205142 Feb 21 01:45:54.881961 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 565/1142] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:54 2022] GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050 => generated 1279 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:54.930414 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-f2fb28ef-99c3-4e21-b269-e464833a7236 req-5f90b910-46da-4b3b-aac8-abdfd6887b7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e48dbd5c-1891-4127-88f0-b5fc420b3050", "tag": "45e77b5d-c782-4bfb-aceb-6f6a3e918af1"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:45:54.932138 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:45:54.932138 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:45:54.944211 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f2fb28ef-99c3-4e21-b269-e464833a7236 req-5f90b910-46da-4b3b-aac8-abdfd6887b7c service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:54.944211 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-f2fb28ef-99c3-4e21-b269-e464833a7236 req-5f90b910-46da-4b3b-aac8-abdfd6887b7c service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:54.952092 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-f2fb28ef-99c3-4e21-b269-e464833a7236 req-5f90b910-46da-4b3b-aac8-abdfd6887b7c service nova] Creating event network-changed:45e77b5d-c782-4bfb-aceb-6f6a3e918af1 for instance e48dbd5c-1891-4127-88f0-b5fc420b3050 on hv-cinder-81322 Feb 21 01:45:54.957019 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-f2fb28ef-99c3-4e21-b269-e464833a7236 req-5f90b910-46da-4b3b-aac8-abdfd6887b7c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033881 Feb 21 01:45:54.957710 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 578/1143] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:45:55.898825 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-81f41b48-085e-43f9-92e8-54dbef068648 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:55.899532 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-81f41b48-085e-43f9-92e8-54dbef068648 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: e48dbd5c-1891-4127-88f0-b5fc420b3050] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:55.906801 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81f41b48-085e-43f9-92e8-54dbef068648 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:55.907007 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81f41b48-085e-43f9-92e8-54dbef068648 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:55.907795 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81f41b48-085e-43f9-92e8-54dbef068648 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:55.908229 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-81f41b48-085e-43f9-92e8-54dbef068648 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:56.042711 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-81f41b48-085e-43f9-92e8-54dbef068648 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:56.049854 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-81f41b48-085e-43f9-92e8-54dbef068648 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050" status: 200 len: 1267 microversion: 2.1 time: 0.154802 Feb 21 01:45:56.050419 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 566/1144] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:55 2022] GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:57.068491 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-1c99e425-31ac-454b-b11a-9f7080802516 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:57.069181 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-1c99e425-31ac-454b-b11a-9f7080802516 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: e48dbd5c-1891-4127-88f0-b5fc420b3050] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:57.075205 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c99e425-31ac-454b-b11a-9f7080802516 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:57.076295 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c99e425-31ac-454b-b11a-9f7080802516 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:57.077076 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c99e425-31ac-454b-b11a-9f7080802516 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:57.077514 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-1c99e425-31ac-454b-b11a-9f7080802516 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:57.216632 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-1c99e425-31ac-454b-b11a-9f7080802516 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:57.223794 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-1c99e425-31ac-454b-b11a-9f7080802516 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050" status: 200 len: 1267 microversion: 2.1 time: 0.159822 Feb 21 01:45:57.224341 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 579/1145] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:57 2022] GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:58.240273 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-291203ed-b640-4ce2-985d-f1461aab41e0 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:58.241161 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-291203ed-b640-4ce2-985d-f1461aab41e0 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: e48dbd5c-1891-4127-88f0-b5fc420b3050] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:58.247337 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-291203ed-b640-4ce2-985d-f1461aab41e0 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:58.247778 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-291203ed-b640-4ce2-985d-f1461aab41e0 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:58.248575 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-291203ed-b640-4ce2-985d-f1461aab41e0 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:58.249002 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-291203ed-b640-4ce2-985d-f1461aab41e0 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:58.383562 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-291203ed-b640-4ce2-985d-f1461aab41e0 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:58.392015 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-291203ed-b640-4ce2-985d-f1461aab41e0 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050" status: 200 len: 1267 microversion: 2.1 time: 0.155427 Feb 21 01:45:58.392610 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 567/1146] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:58 2022] GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:45:59.407856 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-09702101-a7bb-4e2a-a64a-0fc98bf6f5da tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:45:59.408479 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-09702101-a7bb-4e2a-a64a-0fc98bf6f5da tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: e48dbd5c-1891-4127-88f0-b5fc420b3050] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:45:59.415050 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09702101-a7bb-4e2a-a64a-0fc98bf6f5da tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:59.415506 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09702101-a7bb-4e2a-a64a-0fc98bf6f5da tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:59.416300 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09702101-a7bb-4e2a-a64a-0fc98bf6f5da tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:45:59.416772 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-09702101-a7bb-4e2a-a64a-0fc98bf6f5da tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:45:59.559251 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-09702101-a7bb-4e2a-a64a-0fc98bf6f5da tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:45:59.567112 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-09702101-a7bb-4e2a-a64a-0fc98bf6f5da tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050" status: 200 len: 1267 microversion: 2.1 time: 0.162970 Feb 21 01:45:59.567674 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 580/1147] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:45:59 2022] GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:46:00.583269 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-5292d8d3-c3cd-4671-99bb-16a2e0b023f5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:00.583821 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-5292d8d3-c3cd-4671-99bb-16a2e0b023f5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: e48dbd5c-1891-4127-88f0-b5fc420b3050] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:00.590401 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5292d8d3-c3cd-4671-99bb-16a2e0b023f5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:00.590851 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5292d8d3-c3cd-4671-99bb-16a2e0b023f5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:00.591641 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5292d8d3-c3cd-4671-99bb-16a2e0b023f5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:00.592132 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-5292d8d3-c3cd-4671-99bb-16a2e0b023f5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:00.728763 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-5292d8d3-c3cd-4671-99bb-16a2e0b023f5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:46:00.736648 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-5292d8d3-c3cd-4671-99bb-16a2e0b023f5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050" status: 200 len: 1267 microversion: 2.1 time: 0.157375 Feb 21 01:46:00.737214 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 568/1148] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:00 2022] GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:46:01.753803 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c0246078-d620-4042-bcc5-5fe4912d4ccd tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:01.754346 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c0246078-d620-4042-bcc5-5fe4912d4ccd tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: e48dbd5c-1891-4127-88f0-b5fc420b3050] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:01.760603 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0246078-d620-4042-bcc5-5fe4912d4ccd tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:01.761078 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0246078-d620-4042-bcc5-5fe4912d4ccd tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:01.761852 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0246078-d620-4042-bcc5-5fe4912d4ccd tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:01.762290 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c0246078-d620-4042-bcc5-5fe4912d4ccd tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:01.894260 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-c0246078-d620-4042-bcc5-5fe4912d4ccd tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:46:01.902539 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c0246078-d620-4042-bcc5-5fe4912d4ccd tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050" status: 200 len: 1267 microversion: 2.1 time: 0.152471 Feb 21 01:46:01.903106 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 581/1149] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:01 2022] GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:46:02.918900 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-1cb9ceb5-7e0f-465d-bc33-089d0258a636 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:02.919425 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-1cb9ceb5-7e0f-465d-bc33-089d0258a636 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: e48dbd5c-1891-4127-88f0-b5fc420b3050] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:02.926363 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cb9ceb5-7e0f-465d-bc33-089d0258a636 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:02.926810 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cb9ceb5-7e0f-465d-bc33-089d0258a636 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:02.927589 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cb9ceb5-7e0f-465d-bc33-089d0258a636 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:02.928026 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-1cb9ceb5-7e0f-465d-bc33-089d0258a636 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:03.061839 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-1cb9ceb5-7e0f-465d-bc33-089d0258a636 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:46:03.068994 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-1cb9ceb5-7e0f-465d-bc33-089d0258a636 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050" status: 200 len: 1267 microversion: 2.1 time: 0.153890 Feb 21 01:46:03.069556 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 569/1150] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:02 2022] GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:46:04.085331 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-3a730ea2-a62d-4a08-9f7d-d77c0c7e5922 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:04.085949 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-3a730ea2-a62d-4a08-9f7d-d77c0c7e5922 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: e48dbd5c-1891-4127-88f0-b5fc420b3050] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:04.092573 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a730ea2-a62d-4a08-9f7d-d77c0c7e5922 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:04.093288 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a730ea2-a62d-4a08-9f7d-d77c0c7e5922 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:04.095281 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a730ea2-a62d-4a08-9f7d-d77c0c7e5922 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:04.095281 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-3a730ea2-a62d-4a08-9f7d-d77c0c7e5922 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:04.228569 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-3a730ea2-a62d-4a08-9f7d-d77c0c7e5922 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:46:04.237433 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-3a730ea2-a62d-4a08-9f7d-d77c0c7e5922 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050" status: 200 len: 1267 microversion: 2.1 time: 0.154747 Feb 21 01:46:04.237433 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 582/1151] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:04 2022] GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:46:05.253250 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-7989abbc-c651-409d-bbeb-10a081146e81 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:05.253860 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-7989abbc-c651-409d-bbeb-10a081146e81 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: e48dbd5c-1891-4127-88f0-b5fc420b3050] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:05.259633 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7989abbc-c651-409d-bbeb-10a081146e81 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:05.260085 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7989abbc-c651-409d-bbeb-10a081146e81 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:05.260873 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7989abbc-c651-409d-bbeb-10a081146e81 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:05.261299 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-7989abbc-c651-409d-bbeb-10a081146e81 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:05.392604 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-7989abbc-c651-409d-bbeb-10a081146e81 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:46:05.399733 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-7989abbc-c651-409d-bbeb-10a081146e81 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050" status: 200 len: 1267 microversion: 2.1 time: 0.150779 Feb 21 01:46:05.400288 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 570/1152] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:05 2022] GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:46:06.416104 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-b9a20282-f158-45e4-81f3-22b08116252c tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:06.416754 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-b9a20282-f158-45e4-81f3-22b08116252c tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: e48dbd5c-1891-4127-88f0-b5fc420b3050] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:06.423843 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9a20282-f158-45e4-81f3-22b08116252c tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:06.424297 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9a20282-f158-45e4-81f3-22b08116252c tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:06.425108 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9a20282-f158-45e4-81f3-22b08116252c tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:06.425545 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-b9a20282-f158-45e4-81f3-22b08116252c tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:06.439158 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-890c2a59-d743-4af2-8f79-5cdbab159800 req-46a778e6-e702-4ada-826a-d387256dd364 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e48dbd5c-1891-4127-88f0-b5fc420b3050", "name": "network-vif-plugged", "status": "completed", "tag": "45e77b5d-c782-4bfb-aceb-6f6a3e918af1"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:46:06.443851 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:46:06.443851 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:46:06.448125 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-890c2a59-d743-4af2-8f79-5cdbab159800 req-46a778e6-e702-4ada-826a-d387256dd364 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:06.448682 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-890c2a59-d743-4af2-8f79-5cdbab159800 req-46a778e6-e702-4ada-826a-d387256dd364 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:06.459671 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-890c2a59-d743-4af2-8f79-5cdbab159800 req-46a778e6-e702-4ada-826a-d387256dd364 service nova] Creating event network-vif-plugged:45e77b5d-c782-4bfb-aceb-6f6a3e918af1 for instance e48dbd5c-1891-4127-88f0-b5fc420b3050 on hv-cinder-81322 Feb 21 01:46:06.464636 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-890c2a59-d743-4af2-8f79-5cdbab159800 req-46a778e6-e702-4ada-826a-d387256dd364 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029690 Feb 21 01:46:06.465168 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 571/1153] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:46:06.568629 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-b9a20282-f158-45e4-81f3-22b08116252c tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:46:06.576463 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-b9a20282-f158-45e4-81f3-22b08116252c tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050" status: 200 len: 1267 microversion: 2.1 time: 0.164088 Feb 21 01:46:06.577040 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 583/1154] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:06 2022] GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:46:07.594793 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e173799f-bd17-48cd-badc-bbba9eccce53 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:07.595497 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e173799f-bd17-48cd-badc-bbba9eccce53 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: e48dbd5c-1891-4127-88f0-b5fc420b3050] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:07.601597 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e173799f-bd17-48cd-badc-bbba9eccce53 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:07.602052 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e173799f-bd17-48cd-badc-bbba9eccce53 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:07.602828 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e173799f-bd17-48cd-badc-bbba9eccce53 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:07.603284 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e173799f-bd17-48cd-badc-bbba9eccce53 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:07.741369 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-e173799f-bd17-48cd-badc-bbba9eccce53 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:46:07.748454 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e173799f-bd17-48cd-badc-bbba9eccce53 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050" status: 200 len: 1267 microversion: 2.1 time: 0.158689 Feb 21 01:46:07.753405 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 572/1155] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:07 2022] GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:46:08.765971 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6962223c-a2dc-4508-8cec-65313cf4ceaf tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:08.766608 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6962223c-a2dc-4508-8cec-65313cf4ceaf tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: e48dbd5c-1891-4127-88f0-b5fc420b3050] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:08.772393 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6962223c-a2dc-4508-8cec-65313cf4ceaf tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:08.772873 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6962223c-a2dc-4508-8cec-65313cf4ceaf tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:08.773640 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6962223c-a2dc-4508-8cec-65313cf4ceaf tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:08.774077 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6962223c-a2dc-4508-8cec-65313cf4ceaf tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:08.906839 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-6962223c-a2dc-4508-8cec-65313cf4ceaf tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:46:08.915351 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6962223c-a2dc-4508-8cec-65313cf4ceaf tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050" status: 200 len: 1453 microversion: 2.1 time: 0.153929 Feb 21 01:46:08.915914 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 584/1156] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:08 2022] GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:46:08.932052 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-88e5e5f1-f244-436e-b8ff-1413f3f4fca4 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:46:08.932698 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-88e5e5f1-f244-436e-b8ff-1413f3f4fca4 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: e48dbd5c-1891-4127-88f0-b5fc420b3050] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:46:08.939421 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88e5e5f1-f244-436e-b8ff-1413f3f4fca4 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:08.939867 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88e5e5f1-f244-436e-b8ff-1413f3f4fca4 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:08.940672 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88e5e5f1-f244-436e-b8ff-1413f3f4fca4 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:08.941112 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-88e5e5f1-f244-436e-b8ff-1413f3f4fca4 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:09.071094 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-88e5e5f1-f244-436e-b8ff-1413f3f4fca4 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:46:09.079228 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-88e5e5f1-f244-436e-b8ff-1413f3f4fca4 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050" status: 200 len: 1453 microversion: 2.1 time: 0.150872 Feb 21 01:46:09.079783 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 573/1157] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:46:08 2022] GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:46:11.250605 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-8e75432d-7098-468e-8017-342e81abc8d2 req-6b4839f4-fc0e-4ff7-8b43-47d661955173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e48dbd5c-1891-4127-88f0-b5fc420b3050", "tag": "45e77b5d-c782-4bfb-aceb-6f6a3e918af1"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:46:11.252083 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:46:11.252083 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:46:11.259080 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-8e75432d-7098-468e-8017-342e81abc8d2 req-6b4839f4-fc0e-4ff7-8b43-47d661955173 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:46:11.259448 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-8e75432d-7098-468e-8017-342e81abc8d2 req-6b4839f4-fc0e-4ff7-8b43-47d661955173 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:46:11.270395 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-8e75432d-7098-468e-8017-342e81abc8d2 req-6b4839f4-fc0e-4ff7-8b43-47d661955173 service nova] Creating event network-changed:45e77b5d-c782-4bfb-aceb-6f6a3e918af1 for instance e48dbd5c-1891-4127-88f0-b5fc420b3050 on hv-cinder-81322 Feb 21 01:46:11.275328 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-8e75432d-7098-468e-8017-342e81abc8d2 req-6b4839f4-fc0e-4ff7-8b43-47d661955173 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028272 Feb 21 01:46:11.275910 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 585/1158] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:47:12.558011 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:47:12.558703 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: Mon Feb 21 01:47:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:48:11.825434 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4a0458b0-75be-4ae0-91e9-cbc405a43418] AMQP server on 10.222.0.90:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 21 01:48:11.829093 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-2a254f71-c7a1-43dc-9e85-cc09276614a7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1317520358", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1828841158", "security_groups": [{"name": "tempest-secgroup-smoke-1551254502"}], "block_device_mapping_v2": [{"uuid": "aa0539fe-10e9-4cfc-8c47-e275a542d69e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "05842dab-dc3d-4a7b-83c4-206a5c07022d"}]}} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:48:12.075106 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.network.neutron [None req-2a254f71-c7a1-43dc-9e85-cc09276614a7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] validate_networks() for [('05842dab-dc3d-4a7b-83c4-206a5c07022d', None, None, None, None, None)] {{(pid=123542) validate_networks /opt/stack/nova/nova/network/neutron.py:2633}} Feb 21 01:48:12.518843 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-2a254f71-c7a1-43dc-9e85-cc09276614a7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Flavor limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 21 01:48:12.519258 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-2a254f71-c7a1-43dc-9e85-cc09276614a7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Image limits 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 21 01:48:12.519727 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-2a254f71-c7a1-43dc-9e85-cc09276614a7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Flavor pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 21 01:48:12.520128 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-2a254f71-c7a1-43dc-9e85-cc09276614a7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Image pref 0:0:0 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 21 01:48:12.520584 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.virt.hardware [None req-2a254f71-c7a1-43dc-9e85-cc09276614a7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 21 01:48:12.529025 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a254f71-c7a1-43dc-9e85-cc09276614a7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:12.529472 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a254f71-c7a1-43dc-9e85-cc09276614a7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:12.530280 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a254f71-c7a1-43dc-9e85-cc09276614a7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:12.530718 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-2a254f71-c7a1-43dc-9e85-cc09276614a7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:12.546297 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-2a254f71-c7a1-43dc-9e85-cc09276614a7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Getting quotas for project 94593ad3d3934da1ab80ce0c851c7d3e. Resources: {'ram', 'cores', 'instances'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 21 01:48:12.550201 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.quota [None req-2a254f71-c7a1-43dc-9e85-cc09276614a7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Getting quotas for user fa4b889b3aff47cea0a0d254870515cd and project 94593ad3d3934da1ab80ce0c851c7d3e. Resources: {'ram', 'cores', 'instances'} {{(pid=123542) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 21 01:48:12.603247 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2a254f71-c7a1-43dc-9e85-cc09276614a7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Going to run 1 instances... {{(pid=123542) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 21 01:48:12.605468 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-2a254f71-c7a1-43dc-9e85-cc09276614a7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aa0539fe-10e9-4cfc-8c47-e275a542d69e',volume_size=None,volume_type=None)] {{(pid=123542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 21 01:48:12.833666 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] [4a0458b0-75be-4ae0-91e9-cbc405a43418] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 34214. Feb 21 01:48:13.010623 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2a254f71-c7a1-43dc-9e85-cc09276614a7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [2effc945-c1ed-49be-9566-836aa9407e7d] AMQP server on 10.222.0.90:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 21 01:48:14.017638 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [None req-2a254f71-c7a1-43dc-9e85-cc09276614a7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [2effc945-c1ed-49be-9566-836aa9407e7d] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 34216. Feb 21 01:48:14.022434 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-2a254f71-c7a1-43dc-9e85-cc09276614a7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.198938 Feb 21 01:48:14.023149 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 574/1159] 10.222.0.90 () {60 vars in 1146 bytes} [Mon Feb 21 01:48:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 2200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 21 01:48:14.030967 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2ff773aa-d72c-49fb-888e-477b026130e8] AMQP server on 10.222.0.90:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 21 01:48:14.034800 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d74a3991-72d5-4b03-92bd-becfb2636231 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:14.035488 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d74a3991-72d5-4b03-92bd-becfb2636231 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:14.136257 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-d74a3991-72d5-4b03-92bd-becfb2636231 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:14.143256 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d74a3991-72d5-4b03-92bd-becfb2636231 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8" status: 200 len: 1095 microversion: 2.1 time: 0.113983 Feb 21 01:48:14.144534 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 586/1160] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:14 2022] GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 => generated 1095 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:15.161063 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-175c0bcb-445e-4bc0-9613-0a82db28063c tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:15.161696 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-175c0bcb-445e-4bc0-9613-0a82db28063c tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:15.167815 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-175c0bcb-445e-4bc0-9613-0a82db28063c tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:15.168252 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-175c0bcb-445e-4bc0-9613-0a82db28063c tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:15.169055 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-175c0bcb-445e-4bc0-9613-0a82db28063c tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:15.169527 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-175c0bcb-445e-4bc0-9613-0a82db28063c tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:15.229597 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-175c0bcb-445e-4bc0-9613-0a82db28063c tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:15.237655 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-175c0bcb-445e-4bc0-9613-0a82db28063c tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8" status: 200 len: 1145 microversion: 2.1 time: 0.080397 Feb 21 01:48:15.238215 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 575/1161] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:15 2022] GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:16.255451 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6adb9a9f-0daf-433e-b7ba-ed7a359740a8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:16.256072 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6adb9a9f-0daf-433e-b7ba-ed7a359740a8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:16.266552 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] [2ff773aa-d72c-49fb-888e-477b026130e8] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 34240. Feb 21 01:48:16.271730 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6adb9a9f-0daf-433e-b7ba-ed7a359740a8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:16.272186 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6adb9a9f-0daf-433e-b7ba-ed7a359740a8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:16.272999 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6adb9a9f-0daf-433e-b7ba-ed7a359740a8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:16.273453 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6adb9a9f-0daf-433e-b7ba-ed7a359740a8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:16.360117 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-6adb9a9f-0daf-433e-b7ba-ed7a359740a8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:16.366069 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6adb9a9f-0daf-433e-b7ba-ed7a359740a8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8" status: 200 len: 1211 microversion: 2.1 time: 0.115305 Feb 21 01:48:16.366756 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 587/1162] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:16 2022] GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 => generated 1211 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:17.387262 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-0839b6ae-94b3-44e7-af93-a607dbfea093 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:17.387863 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-0839b6ae-94b3-44e7-af93-a607dbfea093 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:17.395360 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0839b6ae-94b3-44e7-af93-a607dbfea093 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:17.395922 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0839b6ae-94b3-44e7-af93-a607dbfea093 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:17.396720 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0839b6ae-94b3-44e7-af93-a607dbfea093 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:17.397333 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-0839b6ae-94b3-44e7-af93-a607dbfea093 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:17.610618 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-0839b6ae-94b3-44e7-af93-a607dbfea093 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:17.617936 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-0839b6ae-94b3-44e7-af93-a607dbfea093 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8" status: 200 len: 1267 microversion: 2.1 time: 0.234767 Feb 21 01:48:17.618507 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 576/1163] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:17 2022] GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:17.780796 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-7c6d27be-e97c-4fc4-ab83-6c802ad72d8e req-bee3a6a5-2fad-4d05-b42e-8632cf545ffa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8", "tag": "d6b9f5e9-0fee-4342-9f19-93f3fbf12945"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:48:17.782594 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:48:17.782594 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:48:17.789979 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7c6d27be-e97c-4fc4-ab83-6c802ad72d8e req-bee3a6a5-2fad-4d05-b42e-8632cf545ffa service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:17.790558 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-7c6d27be-e97c-4fc4-ab83-6c802ad72d8e req-bee3a6a5-2fad-4d05-b42e-8632cf545ffa service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:17.802374 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-7c6d27be-e97c-4fc4-ab83-6c802ad72d8e req-bee3a6a5-2fad-4d05-b42e-8632cf545ffa service nova] Creating event network-changed:d6b9f5e9-0fee-4342-9f19-93f3fbf12945 for instance 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 on hv-cinder-81322 Feb 21 01:48:17.807519 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-7c6d27be-e97c-4fc4-ab83-6c802ad72d8e req-bee3a6a5-2fad-4d05-b42e-8632cf545ffa service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095281 Feb 21 01:48:17.808116 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 588/1164] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:48:18.634526 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-00fa7113-bbf2-4700-87a9-8ee05ec3b566 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:18.635249 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-00fa7113-bbf2-4700-87a9-8ee05ec3b566 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:18.641836 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00fa7113-bbf2-4700-87a9-8ee05ec3b566 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:18.642282 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00fa7113-bbf2-4700-87a9-8ee05ec3b566 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:18.643072 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00fa7113-bbf2-4700-87a9-8ee05ec3b566 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:18.643503 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-00fa7113-bbf2-4700-87a9-8ee05ec3b566 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:18.826706 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-00fa7113-bbf2-4700-87a9-8ee05ec3b566 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:18.834602 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-00fa7113-bbf2-4700-87a9-8ee05ec3b566 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8" status: 200 len: 1267 microversion: 2.1 time: 0.203708 Feb 21 01:48:18.835180 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 577/1165] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:18 2022] GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:19.851856 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-ce2876cd-316e-4fcb-a16f-905bab846524 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:19.852591 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-ce2876cd-316e-4fcb-a16f-905bab846524 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:19.858691 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce2876cd-316e-4fcb-a16f-905bab846524 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:19.859143 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce2876cd-316e-4fcb-a16f-905bab846524 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:19.859925 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce2876cd-316e-4fcb-a16f-905bab846524 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:19.860364 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-ce2876cd-316e-4fcb-a16f-905bab846524 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:20.002169 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-ce2876cd-316e-4fcb-a16f-905bab846524 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:20.009422 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-ce2876cd-316e-4fcb-a16f-905bab846524 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8" status: 200 len: 1267 microversion: 2.1 time: 0.162082 Feb 21 01:48:20.009980 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 589/1166] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:19 2022] GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:21.026011 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-577bc668-a87e-4641-9eb6-8777c36c7b20 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:21.026546 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-577bc668-a87e-4641-9eb6-8777c36c7b20 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:21.032774 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-577bc668-a87e-4641-9eb6-8777c36c7b20 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:21.033225 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-577bc668-a87e-4641-9eb6-8777c36c7b20 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:21.034595 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-577bc668-a87e-4641-9eb6-8777c36c7b20 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:21.035029 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-577bc668-a87e-4641-9eb6-8777c36c7b20 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:21.163159 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-577bc668-a87e-4641-9eb6-8777c36c7b20 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:21.170349 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-577bc668-a87e-4641-9eb6-8777c36c7b20 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8" status: 200 len: 1267 microversion: 2.1 time: 0.148078 Feb 21 01:48:21.170915 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 578/1167] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:21 2022] GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:22.187052 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-257e1fed-cdb6-495f-bc35-48e1c934037f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:22.187581 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-257e1fed-cdb6-495f-bc35-48e1c934037f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:22.194459 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-257e1fed-cdb6-495f-bc35-48e1c934037f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:22.194912 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-257e1fed-cdb6-495f-bc35-48e1c934037f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:22.195694 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-257e1fed-cdb6-495f-bc35-48e1c934037f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:22.196131 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-257e1fed-cdb6-495f-bc35-48e1c934037f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:22.327761 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-257e1fed-cdb6-495f-bc35-48e1c934037f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:22.335637 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-257e1fed-cdb6-495f-bc35-48e1c934037f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8" status: 200 len: 1267 microversion: 2.1 time: 0.152314 Feb 21 01:48:22.336327 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 590/1168] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:22 2022] GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:48:23.352802 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-d9bc8824-5ae9-4b15-890f-69a2cf349133 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:23.353418 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-d9bc8824-5ae9-4b15-890f-69a2cf349133 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:23.359733 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9bc8824-5ae9-4b15-890f-69a2cf349133 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:23.360186 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9bc8824-5ae9-4b15-890f-69a2cf349133 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:23.360990 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9bc8824-5ae9-4b15-890f-69a2cf349133 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:23.361427 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-d9bc8824-5ae9-4b15-890f-69a2cf349133 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:23.491247 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-d9bc8824-5ae9-4b15-890f-69a2cf349133 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:23.498581 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-d9bc8824-5ae9-4b15-890f-69a2cf349133 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8" status: 200 len: 1267 microversion: 2.1 time: 0.149457 Feb 21 01:48:23.499153 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 579/1169] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:23 2022] GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:24.515209 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-a7ba061c-573c-4597-89fd-939ed425f850 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:24.515821 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-a7ba061c-573c-4597-89fd-939ed425f850 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:24.522086 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7ba061c-573c-4597-89fd-939ed425f850 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:24.522532 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7ba061c-573c-4597-89fd-939ed425f850 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:24.523300 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7ba061c-573c-4597-89fd-939ed425f850 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:24.523734 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-a7ba061c-573c-4597-89fd-939ed425f850 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:24.655229 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-a7ba061c-573c-4597-89fd-939ed425f850 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:24.663205 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-a7ba061c-573c-4597-89fd-939ed425f850 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8" status: 200 len: 1267 microversion: 2.1 time: 0.151918 Feb 21 01:48:24.663762 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 591/1170] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:24 2022] GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:25.679307 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6815c871-e369-42d4-aa9e-136c0567195f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:25.679973 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6815c871-e369-42d4-aa9e-136c0567195f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:25.686307 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6815c871-e369-42d4-aa9e-136c0567195f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:25.686756 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6815c871-e369-42d4-aa9e-136c0567195f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:25.687535 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6815c871-e369-42d4-aa9e-136c0567195f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:25.687966 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6815c871-e369-42d4-aa9e-136c0567195f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:25.911523 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-6815c871-e369-42d4-aa9e-136c0567195f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:25.918733 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6815c871-e369-42d4-aa9e-136c0567195f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8" status: 200 len: 1267 microversion: 2.1 time: 0.243057 Feb 21 01:48:25.919302 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 580/1171] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:25 2022] GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 => generated 1267 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:26.935433 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-6957d877-39a5-4527-8a4a-49d5401483ee tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:26.936000 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-6957d877-39a5-4527-8a4a-49d5401483ee tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:26.948844 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6957d877-39a5-4527-8a4a-49d5401483ee tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:26.949288 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6957d877-39a5-4527-8a4a-49d5401483ee tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:26.950065 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6957d877-39a5-4527-8a4a-49d5401483ee tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:26.950494 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-6957d877-39a5-4527-8a4a-49d5401483ee tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:27.087324 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-6957d877-39a5-4527-8a4a-49d5401483ee tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:27.094642 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-6957d877-39a5-4527-8a4a-49d5401483ee tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8" status: 200 len: 1267 microversion: 2.1 time: 0.163119 Feb 21 01:48:27.095207 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 592/1172] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:26 2022] GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:28.112286 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-051ead63-cecc-4197-8546-47abfb799cc5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:28.112930 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-051ead63-cecc-4197-8546-47abfb799cc5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:28.119286 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-051ead63-cecc-4197-8546-47abfb799cc5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:28.119740 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-051ead63-cecc-4197-8546-47abfb799cc5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:28.120613 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-051ead63-cecc-4197-8546-47abfb799cc5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:28.121053 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-051ead63-cecc-4197-8546-47abfb799cc5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:28.251218 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-051ead63-cecc-4197-8546-47abfb799cc5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:28.258350 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-051ead63-cecc-4197-8546-47abfb799cc5 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8" status: 200 len: 1267 microversion: 2.1 time: 0.150354 Feb 21 01:48:28.258915 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 581/1173] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:28 2022] GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:29.102828 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-04a69aec-f368-47c6-95cd-4119bd76b7b0 req-a5361a22-3eda-4d24-b3c9-30e346de0f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8", "name": "network-vif-plugged", "status": "completed", "tag": "d6b9f5e9-0fee-4342-9f19-93f3fbf12945"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:48:29.104331 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:48:29.104331 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:48:29.111521 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-04a69aec-f368-47c6-95cd-4119bd76b7b0 req-a5361a22-3eda-4d24-b3c9-30e346de0f51 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:29.111967 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-04a69aec-f368-47c6-95cd-4119bd76b7b0 req-a5361a22-3eda-4d24-b3c9-30e346de0f51 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:29.122374 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-04a69aec-f368-47c6-95cd-4119bd76b7b0 req-a5361a22-3eda-4d24-b3c9-30e346de0f51 service nova] Creating event network-vif-plugged:d6b9f5e9-0fee-4342-9f19-93f3fbf12945 for instance 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 on hv-cinder-81322 Feb 21 01:48:29.128392 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-04a69aec-f368-47c6-95cd-4119bd76b7b0 req-a5361a22-3eda-4d24-b3c9-30e346de0f51 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028158 Feb 21 01:48:29.128553 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 593/1174] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:48:29.274894 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-34e7d164-9721-43ec-a0b0-01d2e762e78e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:29.275496 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-34e7d164-9721-43ec-a0b0-01d2e762e78e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:29.281786 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34e7d164-9721-43ec-a0b0-01d2e762e78e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:29.282227 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34e7d164-9721-43ec-a0b0-01d2e762e78e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:29.282988 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34e7d164-9721-43ec-a0b0-01d2e762e78e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:29.283821 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-34e7d164-9721-43ec-a0b0-01d2e762e78e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:29.414885 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-34e7d164-9721-43ec-a0b0-01d2e762e78e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:29.422476 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-34e7d164-9721-43ec-a0b0-01d2e762e78e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8" status: 200 len: 1267 microversion: 2.1 time: 0.151278 Feb 21 01:48:29.423048 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 582/1175] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:29 2022] GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 21 01:48:30.440482 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-c3a466c1-f0df-4259-97bc-ccd904c31c7f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:30.441197 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-c3a466c1-f0df-4259-97bc-ccd904c31c7f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:30.447462 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3a466c1-f0df-4259-97bc-ccd904c31c7f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:30.447934 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3a466c1-f0df-4259-97bc-ccd904c31c7f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:30.448742 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3a466c1-f0df-4259-97bc-ccd904c31c7f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:30.449177 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-c3a466c1-f0df-4259-97bc-ccd904c31c7f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:30.579654 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-c3a466c1-f0df-4259-97bc-ccd904c31c7f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:30.587253 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-c3a466c1-f0df-4259-97bc-ccd904c31c7f tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8" status: 200 len: 1267 microversion: 2.1 time: 0.151187 Feb 21 01:48:30.587813 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 594/1176] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:30 2022] GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:31.604482 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-e1eebebc-f313-498a-a620-8ceada833d9e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:31.605095 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-e1eebebc-f313-498a-a620-8ceada833d9e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:31.611292 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1eebebc-f313-498a-a620-8ceada833d9e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:31.612255 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1eebebc-f313-498a-a620-8ceada833d9e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:31.613062 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1eebebc-f313-498a-a620-8ceada833d9e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:31.613503 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-e1eebebc-f313-498a-a620-8ceada833d9e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:31.747458 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-e1eebebc-f313-498a-a620-8ceada833d9e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:31.755148 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-e1eebebc-f313-498a-a620-8ceada833d9e tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8" status: 200 len: 1454 microversion: 2.1 time: 0.154364 Feb 21 01:48:31.755722 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 583/1177] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:31 2022] GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:31.771042 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-73de0c27-8c97-4812-bc13-f4d928b70dad tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:48:31.771646 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-73de0c27-8c97-4812-bc13-f4d928b70dad tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:48:31.777783 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73de0c27-8c97-4812-bc13-f4d928b70dad tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:31.778226 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73de0c27-8c97-4812-bc13-f4d928b70dad tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:31.778980 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73de0c27-8c97-4812-bc13-f4d928b70dad tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:31.779406 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-73de0c27-8c97-4812-bc13-f4d928b70dad tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:31.909063 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-73de0c27-8c97-4812-bc13-f4d928b70dad tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:48:31.916180 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-73de0c27-8c97-4812-bc13-f4d928b70dad tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8" status: 200 len: 1454 microversion: 2.1 time: 0.148776 Feb 21 01:48:31.916830 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 595/1178] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:48:31 2022] GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 => generated 1454 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:48:33.926723 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-532e86eb-3ef6-4706-9e03-499c3cd0d19d req-0a819ee6-eaba-4e5e-a5c1-4c6c9b3f95a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8", "tag": "d6b9f5e9-0fee-4342-9f19-93f3fbf12945"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:48:33.928404 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:48:33.928404 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:48:33.942802 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-532e86eb-3ef6-4706-9e03-499c3cd0d19d req-0a819ee6-eaba-4e5e-a5c1-4c6c9b3f95a0 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:48:33.943355 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-532e86eb-3ef6-4706-9e03-499c3cd0d19d req-0a819ee6-eaba-4e5e-a5c1-4c6c9b3f95a0 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:48:33.956242 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-532e86eb-3ef6-4706-9e03-499c3cd0d19d req-0a819ee6-eaba-4e5e-a5c1-4c6c9b3f95a0 service nova] Creating event network-changed:d6b9f5e9-0fee-4342-9f19-93f3fbf12945 for instance 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 on hv-cinder-81322 Feb 21 01:48:33.959871 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [req-532e86eb-3ef6-4706-9e03-499c3cd0d19d req-0a819ee6-eaba-4e5e-a5c1-4c6c9b3f95a0 service nova] [e8bfd896-025c-43d9-bc5f-8d816a8e3405] AMQP server on 10.222.0.90:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 21 01:48:34.967981 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [req-532e86eb-3ef6-4706-9e03-499c3cd0d19d req-0a819ee6-eaba-4e5e-a5c1-4c6c9b3f95a0 service nova] [e8bfd896-025c-43d9-bc5f-8d816a8e3405] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 34288. Feb 21 01:48:34.980456 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-532e86eb-3ef6-4706-9e03-499c3cd0d19d req-0a819ee6-eaba-4e5e-a5c1-4c6c9b3f95a0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.050032 Feb 21 01:48:34.981288 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 584/1179] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:48:41.926971 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:48:41.927565 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: Mon Feb 21 01:48:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:48:54.032667 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:48:54.033190 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: Mon Feb 21 01:48:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:50:25.966404 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-03171fca-9f34-47bc-bd96-8185a0b39072 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:50:25.966937 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4a0458b0-75be-4ae0-91e9-cbc405a43418] AMQP server on 10.222.0.90:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Feb 21 01:50:25.967307 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-03171fca-9f34-47bc-bd96-8185a0b39072 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:50:25.971137 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-39555912-122f-416e-ba01-0cad23f95150 req-8784276d-bde7-4038-8fa5-2858177ef462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8", "tag": "d6b9f5e9-0fee-4342-9f19-93f3fbf12945"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:50:25.972764 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:50:25.972764 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:50:25.972987 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03171fca-9f34-47bc-bd96-8185a0b39072 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:25.973285 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03171fca-9f34-47bc-bd96-8185a0b39072 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:25.974056 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03171fca-9f34-47bc-bd96-8185a0b39072 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:25.974486 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-03171fca-9f34-47bc-bd96-8185a0b39072 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:25.992131 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-39555912-122f-416e-ba01-0cad23f95150 req-8784276d-bde7-4038-8fa5-2858177ef462 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:25.992656 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-39555912-122f-416e-ba01-0cad23f95150 req-8784276d-bde7-4038-8fa5-2858177ef462 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:26.001777 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-03171fca-9f34-47bc-bd96-8185a0b39072 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8] Going to try to terminate instance {{(pid=123541) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:50:26.004203 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-39555912-122f-416e-ba01-0cad23f95150 req-8784276d-bde7-4038-8fa5-2858177ef462 service nova] Creating event network-changed:d6b9f5e9-0fee-4342-9f19-93f3fbf12945 for instance 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 on hv-cinder-81322 Feb 21 01:50:26.010450 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-39555912-122f-416e-ba01-0cad23f95150 req-8784276d-bde7-4038-8fa5-2858177ef462 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046998 Feb 21 01:50:26.012635 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 585/1180] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:50:26.307306 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-03171fca-9f34-47bc-bd96-8185a0b39072 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "DELETE /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8" status: 204 len: 0 microversion: 2.1 time: 0.346807 Feb 21 01:50:26.308030 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 596/1181] 10.222.0.90 () {58 vars in 1238 bytes} [Mon Feb 21 01:50:25 2022] DELETE /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:50:26.316454 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-23c4ec74-68a0-4a0c-b3c3-de661beed312 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:50:26.317156 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-23c4ec74-68a0-4a0c-b3c3-de661beed312 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:50:26.323979 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23c4ec74-68a0-4a0c-b3c3-de661beed312 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:26.324588 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23c4ec74-68a0-4a0c-b3c3-de661beed312 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:26.325423 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23c4ec74-68a0-4a0c-b3c3-de661beed312 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:26.325868 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-23c4ec74-68a0-4a0c-b3c3-de661beed312 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:26.556700 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-23c4ec74-68a0-4a0c-b3c3-de661beed312 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:50:26.564452 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-23c4ec74-68a0-4a0c-b3c3-de661beed312 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8" status: 200 len: 1579 microversion: 2.1 time: 0.251984 Feb 21 01:50:26.565316 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 586/1182] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:50:26 2022] GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 => generated 1579 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:50:27.583107 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-20f7541e-179d-454e-a2d6-6112f5cec118 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:50:27.583799 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-20f7541e-179d-454e-a2d6-6112f5cec118 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:50:27.590103 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20f7541e-179d-454e-a2d6-6112f5cec118 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:27.590548 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20f7541e-179d-454e-a2d6-6112f5cec118 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:27.591308 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20f7541e-179d-454e-a2d6-6112f5cec118 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:27.591736 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-20f7541e-179d-454e-a2d6-6112f5cec118 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:27.726705 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-20f7541e-179d-454e-a2d6-6112f5cec118 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:50:27.733852 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-20f7541e-179d-454e-a2d6-6112f5cec118 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8" status: 200 len: 1460 microversion: 2.1 time: 0.155253 Feb 21 01:50:27.734402 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 597/1183] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:50:27 2022] GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 => generated 1460 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:50:28.653276 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [req-5b5561c7-4911-4657-8650-5faa772e23f1 req-f7bff153-d38e-4247-8d4a-ce95a57ebac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8", "name": "network-vif-deleted", "tag": "d6b9f5e9-0fee-4342-9f19-93f3fbf12945"}]} {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:50:28.654766 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:50:28.654766 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: warnings.warn(msg) Feb 21 01:50:28.662589 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5b5561c7-4911-4657-8650-5faa772e23f1 req-f7bff153-d38e-4247-8d4a-ce95a57ebac5 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:28.663535 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [req-5b5561c7-4911-4657-8650-5faa772e23f1 req-f7bff153-d38e-4247-8d4a-ce95a57ebac5 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:28.675183 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.compute.server_external_events [req-5b5561c7-4911-4657-8650-5faa772e23f1 req-f7bff153-d38e-4247-8d4a-ce95a57ebac5 service nova] Creating event network-vif-deleted:d6b9f5e9-0fee-4342-9f19-93f3fbf12945 for instance 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 on hv-cinder-81322 Feb 21 01:50:28.678621 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] [4a0458b0-75be-4ae0-91e9-cbc405a43418] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 34342. Feb 21 01:50:28.680350 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [req-5b5561c7-4911-4657-8650-5faa772e23f1 req-f7bff153-d38e-4247-8d4a-ce95a57ebac5 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030662 Feb 21 01:50:28.683951 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 587/1184] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:50:28.751011 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-e776abd9-885c-4c13-b5c6-80e09f7097eb tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:50:28.751642 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-e776abd9-885c-4c13-b5c6-80e09f7097eb tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:50:28.758420 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e776abd9-885c-4c13-b5c6-80e09f7097eb tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:28.758873 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e776abd9-885c-4c13-b5c6-80e09f7097eb tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:28.760113 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e776abd9-885c-4c13-b5c6-80e09f7097eb tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:28.760564 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-e776abd9-885c-4c13-b5c6-80e09f7097eb tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:28.821344 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-e776abd9-885c-4c13-b5c6-80e09f7097eb tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:50:28.828739 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-e776abd9-885c-4c13-b5c6-80e09f7097eb tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8" status: 200 len: 1226 microversion: 2.1 time: 0.081476 Feb 21 01:50:28.829310 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 598/1185] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:50:28 2022] GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:50:29.847400 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-b251174e-8fee-4b8d-91ff-24318101ae59 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:50:29.848020 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-b251174e-8fee-4b8d-91ff-24318101ae59 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:50:29.855275 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b251174e-8fee-4b8d-91ff-24318101ae59 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:29.855720 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b251174e-8fee-4b8d-91ff-24318101ae59 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:29.856567 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b251174e-8fee-4b8d-91ff-24318101ae59 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:29.856994 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b251174e-8fee-4b8d-91ff-24318101ae59 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:29.886516 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b251174e-8fee-4b8d-91ff-24318101ae59 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:29.887010 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-b251174e-8fee-4b8d-91ff-24318101ae59 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:29.887456 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.objects.instance [None req-b251174e-8fee-4b8d-91ff-24318101ae59 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lazy-loading 'fault' on Instance uuid 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 {{(pid=123542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 21 01:50:29.931460 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-b251174e-8fee-4b8d-91ff-24318101ae59 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:50:29.938206 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-b251174e-8fee-4b8d-91ff-24318101ae59 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8" status: 200 len: 1185 microversion: 2.1 time: 0.094985 Feb 21 01:50:29.938770 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 588/1186] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:50:29 2022] GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 => generated 1185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:50:30.954925 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d1c3e9e4-d430-4658-814d-77eafaef7740 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:50:30.955454 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d1c3e9e4-d430-4658-814d-77eafaef7740 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:50:30.962299 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1c3e9e4-d430-4658-814d-77eafaef7740 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:30.962745 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1c3e9e4-d430-4658-814d-77eafaef7740 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:30.963519 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1c3e9e4-d430-4658-814d-77eafaef7740 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:30.963953 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d1c3e9e4-d430-4658-814d-77eafaef7740 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:30.976531 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-d1c3e9e4-d430-4658-814d-77eafaef7740 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] HTTP exception thrown: Instance 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 could not be found. Feb 21 01:50:30.977106 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d1c3e9e4-d430-4658-814d-77eafaef7740 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Returning 404 to user: Instance 9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:50:30.977912 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d1c3e9e4-d430-4658-814d-77eafaef7740 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8" status: 404 len: 111 microversion: 2.1 time: 0.026837 Feb 21 01:50:30.978423 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 599/1187] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:50:30 2022] GET /compute/v2.1/servers/9fa3e43b-9763-4ecf-bcf9-8d7a42c52ee8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:50:32.566420 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:50:32.567100 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: Mon Feb 21 01:50:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:50:34.293392 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-8a36046f-86b9-43ed-87e4-0c7f408c805d req-db84359e-608f-4530-8378-c44fc7403df1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e48dbd5c-1891-4127-88f0-b5fc420b3050", "tag": "45e77b5d-c782-4bfb-aceb-6f6a3e918af1"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:50:34.296378 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-457b07fd-7c61-41cb-bbd2-dc450ad5f2b7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:50:34.297830 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:50:34.297830 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:50:34.298151 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-457b07fd-7c61-41cb-bbd2-dc450ad5f2b7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: e48dbd5c-1891-4127-88f0-b5fc420b3050] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:50:34.304994 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-457b07fd-7c61-41cb-bbd2-dc450ad5f2b7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:34.305448 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-457b07fd-7c61-41cb-bbd2-dc450ad5f2b7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:34.306233 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-457b07fd-7c61-41cb-bbd2-dc450ad5f2b7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:34.306421 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-8a36046f-86b9-43ed-87e4-0c7f408c805d req-db84359e-608f-4530-8378-c44fc7403df1 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:34.306674 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-457b07fd-7c61-41cb-bbd2-dc450ad5f2b7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:34.307195 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-8a36046f-86b9-43ed-87e4-0c7f408c805d req-db84359e-608f-4530-8378-c44fc7403df1 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:34.318373 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-8a36046f-86b9-43ed-87e4-0c7f408c805d req-db84359e-608f-4530-8378-c44fc7403df1 service nova] Creating event network-changed:45e77b5d-c782-4bfb-aceb-6f6a3e918af1 for instance e48dbd5c-1891-4127-88f0-b5fc420b3050 on hv-cinder-81322 Feb 21 01:50:34.323872 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-8a36046f-86b9-43ed-87e4-0c7f408c805d req-db84359e-608f-4530-8378-c44fc7403df1 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034078 Feb 21 01:50:34.324473 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 600/1188] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 21 01:50:34.331184 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-457b07fd-7c61-41cb-bbd2-dc450ad5f2b7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: e48dbd5c-1891-4127-88f0-b5fc420b3050] Going to try to terminate instance {{(pid=123542) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 21 01:50:34.618813 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-457b07fd-7c61-41cb-bbd2-dc450ad5f2b7 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "DELETE /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050" status: 204 len: 0 microversion: 2.1 time: 0.331995 Feb 21 01:50:34.619638 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 589/1189] 10.222.0.90 () {58 vars in 1238 bytes} [Mon Feb 21 01:50:34 2022] DELETE /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 21 01:50:34.628865 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-d0cac90d-8208-42b3-a132-f7d864d426a8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:50:34.629565 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-d0cac90d-8208-42b3-a132-f7d864d426a8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: e48dbd5c-1891-4127-88f0-b5fc420b3050] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:50:34.636393 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0cac90d-8208-42b3-a132-f7d864d426a8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:34.637167 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0cac90d-8208-42b3-a132-f7d864d426a8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:34.637948 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0cac90d-8208-42b3-a132-f7d864d426a8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:34.638384 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-d0cac90d-8208-42b3-a132-f7d864d426a8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:34.871847 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.policy [None req-d0cac90d-8208-42b3-a132-f7d864d426a8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123541) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:50:34.879219 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-d0cac90d-8208-42b3-a132-f7d864d426a8 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050" status: 200 len: 1577 microversion: 2.1 time: 0.254863 Feb 21 01:50:34.880183 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 601/1190] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:50:34 2022] GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050 => generated 1577 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:50:35.897691 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-405e7974-fb42-4f4b-9662-ba1336aca062 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:50:35.898317 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-405e7974-fb42-4f4b-9662-ba1336aca062 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: e48dbd5c-1891-4127-88f0-b5fc420b3050] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:50:35.904673 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-405e7974-fb42-4f4b-9662-ba1336aca062 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:35.905131 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-405e7974-fb42-4f4b-9662-ba1336aca062 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:35.905909 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-405e7974-fb42-4f4b-9662-ba1336aca062 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:35.906341 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-405e7974-fb42-4f4b-9662-ba1336aca062 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:36.038498 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-405e7974-fb42-4f4b-9662-ba1336aca062 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:50:36.045815 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-405e7974-fb42-4f4b-9662-ba1336aca062 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050" status: 200 len: 1459 microversion: 2.1 time: 0.152239 Feb 21 01:50:36.046382 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 590/1191] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:50:35 2022] GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050 => generated 1459 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:50:36.718291 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [req-4ad0b272-3317-47e9-afee-71cbf3235fc3 req-af2d0e31-499f-43aa-96c9-0bed8d598302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e48dbd5c-1891-4127-88f0-b5fc420b3050", "name": "network-vif-deleted", "tag": "45e77b5d-c782-4bfb-aceb-6f6a3e918af1"}]} {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 21 01:50:36.719804 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:50:36.719804 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: warnings.warn(msg) Feb 21 01:50:36.727763 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4ad0b272-3317-47e9-afee-71cbf3235fc3 req-af2d0e31-499f-43aa-96c9-0bed8d598302 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:36.728267 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [req-4ad0b272-3317-47e9-afee-71cbf3235fc3 req-af2d0e31-499f-43aa-96c9-0bed8d598302 service nova] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:36.738796 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.compute.server_external_events [req-4ad0b272-3317-47e9-afee-71cbf3235fc3 req-af2d0e31-499f-43aa-96c9-0bed8d598302 service nova] Creating event network-vif-deleted:45e77b5d-c782-4bfb-aceb-6f6a3e918af1 for instance e48dbd5c-1891-4127-88f0-b5fc420b3050 on hv-cinder-81322 Feb 21 01:50:36.743762 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [req-4ad0b272-3317-47e9-afee-71cbf3235fc3 req-af2d0e31-499f-43aa-96c9-0bed8d598302 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029152 Feb 21 01:50:36.744267 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 602/1192] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Feb 21 01:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 21 01:50:37.062898 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-9417effe-8ba7-4722-a25e-6fda8fe57830 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:50:37.063514 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-9417effe-8ba7-4722-a25e-6fda8fe57830 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: e48dbd5c-1891-4127-88f0-b5fc420b3050] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:50:37.070607 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9417effe-8ba7-4722-a25e-6fda8fe57830 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:37.071057 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9417effe-8ba7-4722-a25e-6fda8fe57830 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:37.071845 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9417effe-8ba7-4722-a25e-6fda8fe57830 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:37.072279 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-9417effe-8ba7-4722-a25e-6fda8fe57830 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:37.137695 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.policy [None req-9417effe-8ba7-4722-a25e-6fda8fe57830 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa4b889b3aff47cea0a0d254870515cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94593ad3d3934da1ab80ce0c851c7d3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123542) authorize /opt/stack/nova/nova/policy.py:199}} Feb 21 01:50:37.145629 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-9417effe-8ba7-4722-a25e-6fda8fe57830 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050" status: 200 len: 1226 microversion: 2.1 time: 0.086314 Feb 21 01:50:37.148081 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 591/1193] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:50:37 2022] GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 21 01:50:38.167294 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2d299fb1-fca4-444e-8c78-5ac5c6eaf4c1 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:50:38.167990 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-2d299fb1-fca4-444e-8c78-5ac5c6eaf4c1 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: e48dbd5c-1891-4127-88f0-b5fc420b3050] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:50:38.175220 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d299fb1-fca4-444e-8c78-5ac5c6eaf4c1 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:38.175667 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d299fb1-fca4-444e-8c78-5ac5c6eaf4c1 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:38.176499 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d299fb1-fca4-444e-8c78-5ac5c6eaf4c1 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:38.176970 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-2d299fb1-fca4-444e-8c78-5ac5c6eaf4c1 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:38.190640 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-2d299fb1-fca4-444e-8c78-5ac5c6eaf4c1 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] HTTP exception thrown: Instance e48dbd5c-1891-4127-88f0-b5fc420b3050 could not be found. Feb 21 01:50:38.191540 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-2d299fb1-fca4-444e-8c78-5ac5c6eaf4c1 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Returning 404 to user: Instance e48dbd5c-1891-4127-88f0-b5fc420b3050 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:50:38.192833 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-2d299fb1-fca4-444e-8c78-5ac5c6eaf4c1 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050" status: 404 len: 111 microversion: 2.1 time: 0.029410 Feb 21 01:50:38.193727 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 603/1194] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:50:38 2022] GET /compute/v2.1/servers/e48dbd5c-1891-4127-88f0-b5fc420b3050 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:50:38.753865 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6de0d586-ff88-4380-9683-fc3c6b5cacd1 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:50:38.754342 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.compute.api [None req-6de0d586-ff88-4380-9683-fc3c6b5cacd1 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] Fetching instance by UUID {{(pid=123542) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:50:38.761060 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6de0d586-ff88-4380-9683-fc3c6b5cacd1 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:38.761502 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6de0d586-ff88-4380-9683-fc3c6b5cacd1 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:38.762272 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6de0d586-ff88-4380-9683-fc3c6b5cacd1 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:38.762703 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG oslo_concurrency.lockutils [None req-6de0d586-ff88-4380-9683-fc3c6b5cacd1 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:38.775928 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.wsgi [None req-6de0d586-ff88-4380-9683-fc3c6b5cacd1 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] HTTP exception thrown: Instance 28ebc3bf-d635-4c37-869a-261c9ec07c18 could not be found. Feb 21 01:50:38.776536 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-6de0d586-ff88-4380-9683-fc3c6b5cacd1 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Returning 404 to user: Instance 28ebc3bf-d635-4c37-869a-261c9ec07c18 could not be found. {{(pid=123542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:50:38.777346 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-6de0d586-ff88-4380-9683-fc3c6b5cacd1 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "DELETE /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18" status: 404 len: 111 microversion: 2.1 time: 0.027144 Feb 21 01:50:38.777860 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 592/1195] 10.222.0.90 () {58 vars in 1238 bytes} [Mon Feb 21 01:50:38 2022] DELETE /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:50:38.785605 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5f68c6ac-aa87-4367-94da-4becc338a5d3 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '>' {{(pid=123541) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:50:38.786265 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.compute.api [None req-5f68c6ac-aa87-4367-94da-4becc338a5d3 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] [instance: 28ebc3bf-d635-4c37-869a-261c9ec07c18] Fetching instance by UUID {{(pid=123541) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 21 01:50:38.791921 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f68c6ac-aa87-4367-94da-4becc338a5d3 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:38.792363 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f68c6ac-aa87-4367-94da-4becc338a5d3 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:38.793165 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f68c6ac-aa87-4367-94da-4becc338a5d3 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 21 01:50:38.793593 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG oslo_concurrency.lockutils [None req-5f68c6ac-aa87-4367-94da-4becc338a5d3 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Lock "cee51e8e-7ef6-449d-9af5-b8ee4b8e6645" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123541) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 21 01:50:38.809017 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.wsgi [None req-5f68c6ac-aa87-4367-94da-4becc338a5d3 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] HTTP exception thrown: Instance 28ebc3bf-d635-4c37-869a-261c9ec07c18 could not be found. Feb 21 01:50:38.809580 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: DEBUG nova.api.openstack.wsgi [None req-5f68c6ac-aa87-4367-94da-4becc338a5d3 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Returning 404 to user: Instance 28ebc3bf-d635-4c37-869a-261c9ec07c18 could not be found. {{(pid=123541) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 21 01:50:38.810377 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO nova.api.openstack.requestlog [None req-5f68c6ac-aa87-4367-94da-4becc338a5d3 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18" status: 404 len: 111 microversion: 2.1 time: 0.028479 Feb 21 01:50:38.810896 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: [pid: 123541|app: 0|req: 604/1196] 10.222.0.90 () {58 vars in 1235 bytes} [Mon Feb 21 01:50:38 2022] GET /compute/v2.1/servers/28ebc3bf-d635-4c37-869a-261c9ec07c18 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 21 01:50:40.396612 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: DEBUG nova.api.openstack.wsgi [None req-da26de50-3384-4a6e-b6b6-5bdb1329c767 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] Calling method '.version_select at 0x7f4075b8d160>' {{(pid=123542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 21 01:50:40.498007 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO nova.api.openstack.requestlog [None req-da26de50-3384-4a6e-b6b6-5bdb1329c767 tempest-TestVolumeBootPattern-703862008 tempest-TestVolumeBootPattern-703862008-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1828841158" status: 202 len: 0 microversion: 2.1 time: 0.105170 Feb 21 01:50:40.498599 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: [pid: 123542|app: 0|req: 593/1197] 10.222.0.90 () {58 vars in 1262 bytes} [Mon Feb 21 01:50:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1828841158 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 21 01:52:01.934738 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:52:01.935396 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: Mon Feb 21 01:52:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:52:39.548377 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:52:39.549079 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: Mon Feb 21 01:52:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:53:43.612783 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:53:43.613421 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: Mon Feb 21 01:53:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:53:52.575173 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:53:52.575920 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: Mon Feb 21 01:53:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:53:54.042968 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:53:54.043599 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: Mon Feb 21 01:53:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:55:21.943077 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:55:21.943637 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: Mon Feb 21 01:55:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:55:43.274498 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:55:43.275090 dv-cinder-813228-6-iscsi devstack@n-api.service[123542]: Mon Feb 21 01:55:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 21 01:55:59.556199 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 21 01:55:59.556960 dv-cinder-813228-6-iscsi devstack@n-api.service[123541]: Mon Feb 21 01:55:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!